Aashish Panthiaashishpanthi.hashnode.net·Sep 3, 2022I created my own search engine from scratchRecently I built a search engine from scratch. Yes, I didn't use code from any existing repository or from any youtube video. I mean, I created a bot that goes to every website and scrapes data from there, stores the data into the database, and from ...Sebghatullah Yusuf and 2 others are discussing this3 people are discussing thisDiscuss·35 likes·493 readsSearch Engines
Antoine Mesnilantoinemesnil.hashnode.net·Nov 8, 2022Scrape images from a search engine with JavaScript and PuppeteerIntroduction In the previous post of this series, we discovered how to use Nodejs and Puppeteer for scraping and searching content on web pages. I recommend reading it first if you have never used Puppeteer or need to set up the project. In this arti...Discuss·14 likes·127 readsIntro to scraping with Javascript and PuppeteerNode.js
Dmytro Krasundmytrokrasun.hashnode.net·Dec 4, 2022Open Graph imagesAlso known as social cards or link previews, these images make a difference between the click and the visit to your site or ignoring it. Boost your brand awareness by generating Open Graph images. In this article, I share with you a few quick ways ho...Discuss·13 likes·46 readssatori
Ivan Karabadzhakjakeroid.hashnode.net·Mar 19, 2023Puppeteer doesn't remove files from temp directoryFrequently I am building bots. They are running on the server and gathering some data. For some of them, I use Puppeteer and headless Chromium instances. That combination works great. However, there is an issue. Puppeteer doesn't remove files from a ...Discusspuppeteer
Mohammad Faisalmdfaisal.hashnode.net·Mar 8, 2023End-to-end testing with ReactJS and PuppeteerPuppeteer is a Node library that provides a high-level API to control Chrome or Chromium over the DevTools Protocol. It can be used to automate tasks in the browser, such as generating screenshots and PDFs or tracking user interactions. It can also b...DiscussReact
Gaurav Ranegara.hashnode.net·Mar 3, 2023Running Browser Automation using PuppeteerI recently stumbled upon a Node library called Puppeteer that's used to automate browser interactions. As per the official documentation, Puppeteer is a Node library that provides a high-level API to control Chromium or Chrome over the DevTools Proto...Discuss·41 readsJavaScript
Ondra UrbanforApify Blogapify.hashnode.net·Mar 2, 2023How to scrape the web with Puppeteer in 2023A complete web scraping and crawling tutorial for Puppeteer. Learn how to start a browser with Puppeteer, click buttons and wait for actions, and how to extract data from websites. From building a basic scraper to large-scale crawling. Puppeteer is a...Discusspuppeteer
Theo VasilisforApify Blogapify.hashnode.net·Feb 23, 2023Puppeteer vs. Selenium for automationnpm install puppeteer or npm install selenium-webdriver? When it comes to choosing between a tool for web automation, many developers go for Puppeteer or Selenium, leaving others who haven’t already picked a favorite wondering which to go for. Both h...Discusspuppeteer
Nazneen Ahmadsuperwriter758.hashnode.net·Jan 29, 2023Cypress vs. Puppeteer: A Detailed ComparisonThe availability of various tools in the market has often kept you thinking about which tool is appropriate for testing the web application. It is important to test the web application to ensure that it functions as per the user’s requirement and giv...DiscussCypress
Jose Larajoselara.hashnode.net·Jan 26, 2023Generating media content on the flyA significant component of my project involves creating media content for the user. This includes various formats suitable for Instagram stories, formatted for optimal display on social media platforms, and even sets of images that can be shared as a...Discuss·68 readsRust
Theo VasilisforApify Blogapify.hashnode.net·Jan 19, 2023Headless browsers: what are they and how do they work?Websites trying to detect headless browsers vs. headless browsers trying to evade detection is a cat-and-mouse game that probably won’t end any time soon. We have a couple of solutions to keep you ahead of that game. If you already know the basics, s...Discuss·28 readsBrowsers
Arjun Adhikariarjunadhikari.hashnode.net·Jan 16, 2023Web Scraping with JSStock prices, product details, company information, sports stats you name it If you wanted to access this information, you’d either have to use whatever format the website uses or copy-paste the information manually into a new document.The process ca...Discuss·2 likes·118 readsJavaScriptNode.js
Lukáš KřivkaforApify Blogapify.hashnode.net·Dec 14, 2022How to scale Puppeteer and PlaywrightScaling web scrapers horizontally across multiple containers for optimal concurrency. Tips and advice for large-scale scraping projects using Puppeteer or Playwright. Lukáš Křivka -- Head of Actor Development and Delivery at Apify -- explains how he ...Discuss·67 readspuppeteer
