Upwork Profile
I am a web scraping professional specializing in crafting efficient and reliable web scraping solutions using advanced Python scripting and automation techniques (websites scraping, crawling & indexing).
With 7 years of experience on Upwork, over 400 jobs, and more than 3500 hours, I have worked on numerous projects in automation, web scraping, crawling, and data exportation in several formats for around 250 clients.
To handle complex web scraping tasks, I develop hybrid solutions using Scrapy and Selenium, which allows me to scrape dynamic sites or JavaScript-heavy websites efficiently, with Selenium for rendering and Scrapy for data extraction, depending on the volume of data to optimize speed.
For static sites, I rely solely on Scrapy for faster scraping, while in cases requiring full browser interaction, I use only Selenium.
I am able to deal with hidden APIs, rotating residential proxies, and captchas (using a service such as 2captcha and integrating their API into my code).
Throughout my journey, I have successfully scraped around 1000 sites spanning various categories such as e-commerce websites, job boards, corporate websites, government websites, community forums, etc.
My services stack includes:
- Scraping sites, whether protected or not
- Scraping images and structuring them in folders and sub-folders if needed
- Automating repetitive tasks to streamline boring or time-consuming processes
I use the following technologies:
- Languages: Python - Visual Basic .NET - C#
- Integrated Development Environment (IDE): Visual Studio Code - Pycharm - Visual Studio
- Scraping Frameworks: Scrapy
- Connection Libraries: requests - urllib - urllib3 - webrequest - httpwebrequest - webclient - httpclient - webbrowser - webkitbrowser - geckobrowser
- Automation Tools (Headless Browsers): Selenium - SeleniumWire - SeleniumBase - Undetected_chromedriver - Playwright
- Extractors: Beautiful Soup (bs4) - lxml
- Extraction Techniques: xpath - CSS selectors - string processing - JSON - regular expressions
- Input/Output Formats: CSV - Excel - MySQL - PostgreSQL - JSON - XML
- Data Manipulation, File Output, Tables: Pandas
The kinds of projects I can create are:
Pure Solutions for Static Sites:
- Requests + Beautiful Soup (bs4)
- Requests + lxml
- Scrapy (GET requests / POST requests)
Pure Solutions for Dynamic Sites:
- Selenium / SeleniumWire / SeleniumBase / Undetected ChromeDriver
- (sometimes used with Beautiful Soup (bs4) or lxml in cases of large tables where Pandas is not enough)
Hybrid Solutions for Semi-Dynamic Sites:
- Selenium-Scrapy: dynamic for crawling, static for scraping
- Scrapy-Selenium: static for crawling, dynamic for scraping
It sounds great but why should you choose me over another freelancer? because according to my clients, I do have the following skills:
I am a talented and skilled freelancer dedicated to crawling & scraping: smart, fast, efficient, reliable, and professional, with a detail-oriented, problem-solving mindset and a positive attitude.
Proactive and honest: I am straightforward, trustworthy, and easy to work with. I'm friendly, cooperative, and a strong team player who delivers high-quality, clean data.
Hard worker willing to go the extra mile: I strive for a perfect understanding of the task at hand, asking all necessary questions if specifications are unclear.
Responsive and transparent: I'm a good communicator, passionate about my work, and always eager to learn new techniques and technologies. I never give up and always provide a sample before larger extractions to ensure everything meets your expectations.
Too many qualities? It may seem like it, but these are not my words—they come from client feedback. Feel free to verify them on my profile... but be ready to paginate through 42 pages of reviews!
Here are a few feedback:
"We recently had the pleasure of working with Eric on a project, and we couldn't be happier with the results. Eric's attention to detail, problem-solving skills, and positive attitude set him apart. If you're looking for a dedicated and talented freelancer, Eric is your go-to person. Looking forward to more successful collaborations"
"Eric is an amazing Upworker, very easy to communicate with, super fast and efficient, a top notch, he comes highly recommended for any data scraping job."