Scrapers I've built
Here are some scrapers I’ve built and some can be rented on Apify.com majority is private, but I can share them with you. Email me if you want me to build one for you! muhamed.didovic@gmail.com
Twitter (X) Profiles and Tweets Scraper
Description: Extract detailed data from Twitter profiles and tweets, including profile information, engagement metrics, and tweet metadata for comprehensive analysis.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports input formats like usernames, profile URLs, and Instagram cross-platform profiles. Configurable concurrency for efficient data extraction.
Input: Twitter profile URLs, usernames, or Instagram profile URLs for cross-platform scraping.
Output: Extracts user information, tweet content, engagement stats, and more.
Twitter Scraper
Zillow Property Scraper
Description: Unlock the power of real estate data with a scraper that extracts detailed property listings from Zillow.com for analysis, market research, and investment strategies.
Technology: Crawlee, Cheerio, Apify
Functionality: Scrape property details, pricing, and location-based data from Zillow with customizable input and depth options, supporting large-scale data extraction.
Input: Zillow search URLs for cities or regions, options to include property details, and settings for concurrency.
Output: Detailed property data including address, price, number of bedrooms and bathrooms, and listing status.
Zillow Scraper
Zalando Product Scraper
Description: Unleash the full potential of Zalando data with a powerful scraper designed to extract comprehensive product details for market analysis, competitive research, and business intelligence.
Technology: Crawlee, Cheerio, Apify
Functionality: Scrape product details, prices, sizes, and images from category and search result pages on Zalando with adjustable scraping parameters and proxy support.
Input: Category or search result URLs from Zalando, with options to set maximum items, concurrency, and retry attempts.
Output: Detailed product information, including product name, price, size availability, images, and stock status.
Zalando Scraper
Edjoin Job Listings Scraper
Description: Unlock detailed insights from educational job listings by extracting comprehensive job information from Edjoin.org. Ideal for job seekers, educational recruiters, and researchers looking for job market insights in the education sector.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports scraping job titles, locations, salary, and application details with customizable search parameters and automatic pagination.
Input: Edjoin search URL with your desired parameters, concurrency settings, and retry attempts.
Output: Job listing details, including job title, district, location, salary, application deadline, and contact information.
Edjoin Job Listings Scraper
Instagram Profile Scraper
Description: Unlock detailed insights from Instagram profiles by extracting user details, engagement metrics, and post data. Ideal for social media marketers, researchers, and analysts looking to gather insights from Instagram profiles.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports scraping profile information, user engagement metrics, and post data, with options to include or exclude post details.
Input: Instagram profile URLs or usernames, include posts flag, concurrency settings, and retry attempts.
Output: Profile details (username, biography, follower count), post details (titles, engagement metrics), and account features (verification status, privacy).
Instagram Profile Scraper
Skool Posts with Comments Scraper
Description: Unlock valuable insights from Skool.com discussions by extracting comprehensive post data and nested comments. Ideal for community analysis and content strategy optimization.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports scraping detailed post information, user details, and nested comments from specific Skool.com community URLs.
Input: Skool community URLs, include comments flag, maximum items to scrape, concurrency settings, and retry attempts.
Output: Post title, content, user details, comment threads, engagement metrics (e.g., upvotes, comment counts).
Skool Community (Tab) with Comments Scraper
Skool.com Members/Users Scraper
Description: Scrapes user details from Skool.com groups, including names, emails, and social media links.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports multiple page URLs, requires authentication, and customizable settings.
Input: Skool.com group member URLs and cookies for authentication.
Output: User details such as names, emails, and links to social media profiles.
Skool.com Members/Users Scraper
Smartbuyglasses Scraper
Description: Extract detailed product information from Smartbuyglasses.com, including product names, colors, materials, and frame details. Ideal for e-commerce analysis, market research, and comparisons in the eyewear industry.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports scraping all products from a specified brand, capturing frame and lens specifications, pricing, image URLs, and compatibility data.
Input: Brand page URLs from Smartbuyglasses.com, proxy settings, maximum items to scrape, concurrency settings, and retries.
Output: Product name, frame color, material, shape, lens details, price, image URLs, prescription compatibility, and more.
Smartbuyglasses Scraper
YouTube Channel Videos Details Scraper
Description: Extract detailed information about all videos from a specific YouTube channel, including titles, descriptions, view counts, publication dates, and more. Perfect for analyzing channel performance, video trends, and content strategies.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports scraping all videos from a specified YouTube channel, capturing comprehensive video metadata, engagement metrics, and rich media assets such as thumbnails.
Input: YouTube channel video URLs, proxy settings, maximum items to scrape, concurrency settings, and retries.
Output: Video ID, title, description snippet, publication date, view count, duration, thumbnails, and other engagement data.
YouTube Channel Videos Details Scraper
YouTube Video Details Scraper
Description: Extract detailed metadata and engagement metrics from YouTube videos, including video title, description, view count, keywords, thumbnail URLs, and more. Ideal for content creators, marketers, and researchers looking to analyze video performance and metadata.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports scraping YouTube video URLs to provide comprehensive video and channel data, along with engagement statistics.
Input: YouTube video URLs, proxy settings, concurrency settings, and retries.
Output: Video title, description, duration, tags, view count, author information, and thumbnail URLs.
YouTube Video Details Scraper
YouTube Search Results Scraper
Description: Extract valuable search results data from YouTube, including video titles, thumbnails, channel information, and engagement metrics. Ideal for content creators, marketers, and researchers seeking to analyze trends or discover new content opportunities.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports scraping both YouTube search URLs and keywords, provides detailed video and channel data, and captures engagement metrics such as views and durations.
Input: YouTube search URLs or keywords, proxy settings, max items, and concurrency configurations.
Output: Video titles, thumbnails, channel information, view counts, video durations, and additional statistics.
YouTube Search Results Scraper
YouTube Comments Scraper
Description: Extract comprehensive comment data from YouTube videos, including author details, engagement metrics, and replies. Ideal for content creators, marketers, and researchers seeking to analyze audience engagement.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports scraping single or multiple videos, provides detailed comment data, and captures engagement metrics (votes, replies) along with author information.
Input: YouTube video URLs, proxy settings, max items, and concurrency configurations.
Output: Comment text, author information, engagement stats (likes, replies), and timestamps for published comments.
YouTube Comments Scraper (with replies)
ZipRecruiter Scraper
Description: Extract comprehensive job listing data from ZipRecruiter including titles, company details, locations, salary, job descriptions, and more.
Technology: Crawlee, Puppeteer, Apify
Functionality: Supports scraping multiple search URLs, gathers detailed job data across categories and industries, handles proxy configurations to avoid IP blocks.
Input: ZipRecruiter search URLs, proxy settings, maxItems, and concurrency configurations.
Output: Job titles, company names, salaries, locations, job descriptions, and links for applying to jobs.
ZipRecruiter.com Job Listings Scraper
Crexi.com Property Listings Scraper
Description: Scrapes property listings from Crexi.com, extracting key details such as property name, description, asking price, location, property type, broker information, and metadata.
Technology: Crawlee, Puppeteer, Apify
Functionality: Supports multiple search URLs from Crexi.com and customizable scraping settings.
Input: Crexi property listing URLs.
Output: Property name, description, asking price, location, property type, broker information, and metadata such as media files, status, and opportunity zone details.
Crexi.com Property Listings Scraper
Chronext.de Scraper
Description: Scrapes detailed watch data from the Chronext website, including specifications, pricing, and availability.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports scraping multiple pages of watch listings with configurable concurrency settings and pagination handling.
Input: Chronext watch listing URLs.
Output: Watch name, price, SKU, condition, specifications (such as model, brand, diameter, etc.), images, and availability status.
Chronext Scraper
Glassdoor Reviews Scraper
Description: Extract detailed employee reviews from Glassdoor. Gather comprehensive insights including ratings, comments, and company responses to inform your HR strategies and market research.
Technology: Crawlee, Puppeteer, Apify
Functionality: Company-specific review scraping, detailed review data extraction, multilingual support, and customizable scraping settings.
Input: Glassdoor company review URLs, cookies, proxy settings.
Output: Review ratings, titles, pros, cons, author details, and company responses.
Glassdoor Reviews Scraper
NoFluffJobs.com Job Listings Scraper
Description: Scrapes job listings from NoFluffJobs.com, extracting comprehensive details such as job title, company information, salary, location, required skills, benefits, and more. The scraper supports multiple regional versions (Poland, Hungary, Czech Republic, Slovakia, and Netherlands) for a complete view of job opportunities.
Technology: Crawlee, Cheerio, Apify
Functionality: Supports cross-region job searches, detailed job information extraction, and multilingual support.
Input: NoFluffJobs search URLs.
Output: Job title, company details, salary, location, required skills, benefits, recruitment process, and various other metadata.
NoFluffJobs Scraper
TikTok Profile Videos Scraper
Description: Unleash the power of TikTok data with our advanced Profile Videos Scraper. Effortlessly extract comprehensive video information from any TikTok profile, providing you with rich insights for content analysis, trend tracking, and more.
Technology: Crawlee, Puppeteer, Apify
Functionality: Profile-specific scraping, comprehensive video data extraction, customizable scraping settings, and proxy support.
Input: TikTok profile URLs, cookies, proxy settings.
Output: Detailed video information including metadata, engagement stats, audio details, and more.
TikTok Profile Videos Scraper
Indeed Scraper Browser Automation
Description: Bypasses protections to extract job listings from Indeed, including job titles, company names, locations, salary estimates, and job descriptions.
Technology: Crawlee, Puppeteer, Apify
Functionality: Supports multiple search queries and customizable settings.
Input: Indeed job listing URLs.
Output: Job titles, company names, locations, salary estimates, job descriptions, application links, company information, and metadata.
Indeed Scraper Browser Automation
Fast Indeed Jobs Scraper (Cheerio cralwer without browser automation)
Description: Allows you to scrape job listings from Indeed.com and retrieve important details such as job title, company name, location, salary information, job description and etc.
Technology: Crawlee, Apify
Functionality: Supports multiple search URLs, customizable parameters, location-based search, metadata extraction, and application details extraction.
Input: Indeed job search URLs with filters such as job title, company name, and location.
Output: Detailed job information, posting details, company information, salary information, job description, application details, job attributes, location information, search and tracking information and etc
Fast Indeed Jobs Scraper
Indeed Review Scraper
Description: Scrapes reviews from Indeed, collecting details like review titles, descriptions, ratings, dates, locations, author job titles, and pros and cons.
Technology: Crawlee, Puppeteer, Apify
Functionality: Supports multiple search queries and customizable settings.
Input: Indeed review URLs and optional parameters like max number of reviews and max date.
Output: Review titles, descriptions, ratings, dates, locations, author job titles, review URLs, pros and cons, and comments.
Indeed Review Scraper
LinkedIn Company People Scraper
Description: Extracts employee information from LinkedIn company pages, including names, positions, profile images, and LinkedIn profile URLs.
Technology: Crawlee, Puppeteer, Apify
Functionality: Supports multiple page URLs, requires authentication, and customizable settings.
Input: LinkedIn company URLs and cookies for authentication.
Output: Names, positions, profile images, LinkedIn profile URLs, and associated company names.
LinkedIn Company People Scraper
Clutch.co Scraper
Description: Scrapes comprehensive company details from Clutch.co, including client reviews, project portfolios, verification statuses, and geographical locations.
Technology: Crawlee, Apify
Functionality: Supports multiple search queries, scrapes category lists, and collects detailed company information.
Input: Clutch.co category list URLs.
Output: Company names, reviews, ratings, locations, websites, and other detailed information.
Clutch.co Comprehensive Scraper
Quora Scraper
Description: Scrapes data from Quora, including questions, answers, and user profiles.
Technology: Crawlee, Puppeteer, Apify
Functionality: Supports multiple search queries and authentication for enhanced data access.
Input: Quora search URLs and cookies for authentication.
Output: Titles, details, and metadata of questions, number of answers, author information, and user profiles.
Quora Scraper
Facebook Search Results Groups Scraper
Description: Scrapes Facebook groups, collecting details like group names, descriptions, privacy status, member counts, activity, and URLs.
Technology: Crawlee, Puppeteer, Apify
Functionality: Supports multiple search queries and customizable configurations.
Input: Facebook group search URLs and cookies for authentication.
Output: Group names, descriptions, privacy status, member counts, activity, and URLs.
Facebook Groups Scraper
Facebook Search Results Pages Scraper
Description: Scrapes Facebook pages, collecting details like page names, descriptions, photos, tags, reviews, and URLs.
Technology: Crawlee, Puppeteer, Apify
Functionality: Supports multiple search queries and customizable configurations.
Input: Facebook page search URLs and cookies for authentication.
Output: Page names, descriptions, photos, tags, reviews, price range, location, hours open, followers, and URLs.
Facebook Search Pages Scraper
Facebook Profile/Bio/Contact Detail Scraper
Description: Scrapes profile details from Facebook profiles.
Technology: Crawlee, Puppeteer, Apify
Functionality: Collects addresses, categories, emails, mobile numbers, likes, websites, ratings, hours open, check-ins, phone information, and social platform links.
Input: Facebook profile URLs and cookies for authentication.
Output: Contact details such as addresses, emails, phone numbers, websites, ratings and etc.
Facebook Page Contact Detail Scraper [Private for now]
Facebook Page Contact Detail Scraper
Description: Scrapes contact details from Facebook pages, including addresses, categories, emails, and phone information.
Technology: Apify
Functionality: Collects addresses, categories, emails, mobile numbers, likes, websites, ratings, hours open, check-ins, phone information, and social platform links.
Input: Facebook page URLs and cookies for authentication.
Output: Contact details such as addresses, emails, phone numbers, websites, ratings, and hours open.
Facebook Page Contact Detail Scraper
Facebook Search and Page Details Scraper
Description: Scrapes Facebook pages from search results and retrieves important details such as page name, description, photo URL, verification status, tags or categories, reviews, price range, location, hours of operation, number of followers, page slug, and page link.
Technology: Crawlee, Puppeteer, Apify
Functionality: Supports multiple search URLs, authentication via cookies, location-based search, detailed page information extraction, customizable parameters, and proxy configuration.
Input: Facebook search URLs and cookies for authentication.
Output: Page name, description, photo URL, verification status, tags or categories, reviews, price range, location, hours of operation, number of followers, page slug, and page link.
Facebook Search and Page Details Scraper
Çiçek(Sepeti) Collection Scraper
Description: Scrapes various product collections/categories from ÇiçekSepeti, including jewelry models, flower arrangements, gift items, and more.
Technology: Crawlee, Puppeteer, Apify
Functionality: Allows input of specific URLs for targeted scraping and configurable to scrape a maximum number of pages per category.
Input: URLs of specific ÇiçekSepeti collections/categories and maximum pages to scrape.
Output: Detailed product information including titles, prices, descriptions, image URLs, and product URLs.
Çiçek(Sepeti) Collection Scraper
Facebook Group Scraper
Description: Scrapes data from Facebook group details for lead generation.
Technology: Crawlee, Puppeteer, Apify
Functionality: Collects details like post text, post links, and email if available.
Input: Facebook group URLs.
Output: Post details including text and email.
Facebook Group Scraper [Private for now]
LinkedIn Search Results Scraper
Description: Scrapes LinkedIn search results for job postings, collecting job titles, descriptions, company details, and more.
Technology: Crawlee, Apify
Functionality: Supports multiple search queries and customizable settings.
Input: LinkedIn search URLs and optional parameters like keywords and location.
Output: Job titles, descriptions, company details, seniority level, employment type, job function, industries, location, number of applicants, and more.
LinkedIn Search Results Scraper [Private for now]
LinkedIn Sales Navigator Scraper
Description: Extracts data from LinkedIn Sales Navigator for lead generation, including Account IQ section data.
Technology: Crawlee, Puppeteer, Apify
Functionality: Scrapes detailed company data like names, titles, company information, and strategic priorities.
Input: Sales Navigator URL or LinkedIn company ID.
Output: Account IQ data, including how the company makes money, strategic priorities, business challenges, competitive landscape, headcount insights, growth rates, and related news.
LinkedIn Sales Navigator Scraper [Private for now]
Shopify Fashionnova Scraper
Description: Scrapes product details from Fashionnova, including product title, description, images, prices, and variants.
Technology: Crawlee, Puppeteer, Apify
Functionality: Allows input of specific product collection URLs for targeted scraping and configurable to scrape a maximum number of items.
Input: URLs of specific Fashionnova product collections and maximum items to scrape.
Output: Detailed product information including URL, ID, title, description, product type, images, brand, category, options, and variants.
Fashionnova Scraper [Private for now]
T5ear Scraper
Description: Scrapes product reviews from T5ear, collecting details like review ID, customer ID, product ID, order ID, rating, review text, admin response, and timestamps.
Technology: Crawlee, Cheerio, Apify
Functionality: Allows input of specific product review URLs for targeted scraping and configurable to scrape a maximum number of reviews.
Input: URLs of specific T5ear product reviews and maximum items to scrape.
Output: Detailed review information including review ID, customer ID, product ID, order ID, rating, review text, admin response, timestamps, and customer details.
T5ear Scraper [Private for now]
Amazon Scraper
Description: Scrapes product details from Amazon, including titles, ASINs, prices, ratings, reviews, and offers from different sellers.
Technology: Crawlee, Puppeteer, Apify, Captcha Solver(Capsolver)
Functionality: Supports multiple product URLs and customizable scraping settings.
Input: Amazon product URLs.
Output: Product titles, ASINs, prices, ratings, reviews, and offers from different sellers.
Amazon Scraper [Private for now]