Completed Project Aug 5 - Aug 11, 2024

Crawler Web Interface

Developed a user interface and API to manage and submit scraping jobs for the crawler.

Technical Overview

  • Scrapy framework for scalable & fast scraping
  • Scrapyd for deploying & interacting with spiders
  • HTML & JS for web interface

Technologies & Skills

Scrapy Scrapyd HTML Javascript
S

Serv Maxi

"Ehsan was very prompt with all the work and shared samples well within the deadline. He was available to answer questions and discuss issues at most times. His communication was top-notch, he met all deadlines, and his skills were reasonably strong. If I have a job that is suitable for his skills, I will definitely try to hire him in the future as well."