DataVisor
- Work on a Rails-based data product that collects and normalizespublic web data for analytics, marketplace monitoring, and internal research teams.
- Built and maintained scraping jobs using Ruby, Sidekiq, Playwright, PostgreSQL, and Redis, including parsers for pages with changing HTML, embedded JSON, and inconsistent pagination.
- Reduced failed collection runs from about 9% to 4% by adding better retry rules, selector fallbacks, and clearer error categories for blocked, missing, and malformed responses.
- Debug browser automation issues with Chrome DevTools, request logs, screenshots, and small reproduction scripts. Some work involved login flows and sites with basic bot checks, but not deep fingerprinting research.
- Handle ordinary product work too: admin pages, customer export fixes, documentation updates, small Rails upgrades, and support questions when a customer’s data looks wrong.
- Work on a Rails-based data product that collects and normalizespublic web data for analytics, marketplace monitoring, and internal research teams.
- Built and maintained scraping jobs using Ruby, Sidekiq, Playwright, PostgreSQL, and Redis, including parsers for pages with changing HTML, embedded JSON, and inconsistent pagination.
- Reduced failed collection runs from about 9% to 4% by adding better retry rules, selector fallbacks, and clearer error categories for blocked, missing, and malformed responses.
- Debug browser automation issues with Chrome DevTools, request logs, screenshots, and small reproduction scripts. Some work involved login flows and sites with basic bot checks, but not deep fingerprinting research.
- Handle ordinary product work too: admin pages, customer export fixes, documentation updates, small Rails upgrades, and support questions when a customer’s data looks wrong.
あなたのforiioを無料で作成
- Work on a Rails-based data product that collects and normalizespublic web data for analytics, marketplace monitoring, and internal research teams.
- Built and maintained scraping jobs using Ruby, Sidekiq, Playwright, PostgreSQL, and Redis, including parsers for pages with changing HTML, embedded JSON, and inconsistent pagination.
- Reduced failed collection runs from about 9% to 4% by adding better retry rules, selector fallbacks, and clearer error categories for blocked, missing, and malformed responses.
- Debug browser automation issues with Chrome DevTools, request logs, screenshots, and small reproduction scripts. Some work involved login flows and sites with basic bot checks, but not deep fingerprinting research.
- Handle ordinary product work too: admin pages, customer export fixes, documentation updates, small Rails upgrades, and support questions when a customer’s data looks wrong.