Puppeteer Questions

I'm trying to make an app on firebase functions (a puppeteer app) and i do have the following in a .json file. it is working great

On a page i'm scraping with puppeteer, i have a list with the same id for every li. i am trying to find and click on an element with

Bellow is the code i'm trying, please help! i'm facing two problems, 1. the browser is opening at

I have a node.js automation which uses puppeteer and loads some urls as part of the process. my code is pretty basic and uses just the very basic

I would like to compare two images in memory as opposed to relying on reading and writing from the file system. i might be going about

With all the changes to the current instagram api i was trying to build a scraper. after some looking around i found puppeteer. although it seems

I have page with several json sources. const results = []; await page.on('response', async (response) => { if

I have a project with node js on web scraping where i will have to scrape heading and text from main content. but the problem is

I am trying to run my first code on puppeteer. puppeteer v1.20.0 node v8.11.3 npm

I have this puppeteer code: (async () => { const browser = await puppeteer.launch({ args: ['--no-sandbox'] }); const page =

Js noob here, i'm trying to create a web scraper to scrape price data off booking websites, but i can't get the data i want, at least not

I have a link for a (gif) image, obtained manually via 'open in new tab'. i want puppeteer to open the image and then save it to a file. if doing

a. consistency is all over the place; running !headless, i watch it sometimes work, sometimes it doesn't (like types in wrong data), it's

I am trying to create some small functions that someone will be able to glue together in order to have a more reusable code base. what i

Hi i have a super simple dockerfile to run puppeteer in docker: from node:12.2.0-alpine run apk update && apk upgrade

How can i click on an outer element that contains a span with specific text via puppeteer? for example i have the following

I have this element structure. <p> <span class="ts-aria-only"> departure </span> ruh <span

I am hacking together a node script in puppeteer where i scrap a webpage and safe the content as a text file where i name the file after the date

My enviroment: puppeteer version: 1.20.0 platform / os version: ubuntu 18.04.3 lts node.js version: 8.10.0

I want to click on an element without using css selectors. await page.click() uses selectors to identify the

I am using nodemon to run my application with nodemon index.js in my index.js file is where i

Question: what is the proper syntax to use my global.parsedata function inside page.evaluate ?

I'm playing around with puppeteer to learn a bit about automation in the browser. i wanted to open the chromium browser visable so not in

I am trying to achieve a synchronous call: puppeteer.launch().then(browser => { let html = `

So i used a while loop so my test will run in a constant loop until my back-end will crash. i've implemented a try and catch(error) so any

I'm building a web scraper with node.js + puppeteer + mongoose. i'm getting the data from the web page and i'm able to save it to the database.

I am asking if it is possible i could use puppeteer in class methods. i read a lot about async/await functions but i could not find anything

I have created a puppeteer script to run in offline, i have got the below code to take the screenshot. while running the

I'm using puppeteer-cluster to crawling web pages. if i open many pages at time per single website (8-10 pages), the connection slow down

I am trying to check if og:image source exists. if i want to call async method in

I was looking for similar functionality in puppeteer with mocha as dataprovider in testng testing framework . can anyone suggest how to achieve it

I have a table looking like that. all the names in the name columns are links that navigate to the next page.

I wrote a web page crawler that successfully crawls a web page and grabs the data of one job posting using puppeteer. i'm now trying

I'm new to async functions and even node.js. i'm trying to crawl a website and grab some data from it. when crawling the website my code randomly

I am trying to crawl an external job posting board and grab the data for each job posting. right now i'm just trying to collect the data for the

I have some code that is filling out a form. it is able to find all the parts i need but it failes to type in one of them. at first, i

I'm trying to run a code like this: const login = "login"; await page.$eval('#loginform_username', el => el.value =

I have a file (for example jpeg size 1588 × 2244px). it's generated by puppeteer (but phantomjs also generate 72

Here is a difference between result pdf on windows and linux. when i'm trying to generate from linux images disappears. that chart images

const puppeteer = require('puppeteer'); const init = async () => { const browser = await puppeteer.launch({ headless:

On a page that does not support downloading images or opening them in new tab, i can use the chrome developer (tools->network) to right click the

So basically i was just wondering if there are any ways to make a puppeteer browser more believeable to a website in that they think it's an

While running my puppeteer app with pm2's cluster mode enabled, during concurrent requests, only one of the processes seems to be utilized instead

At the start of the puppeteer tutorial, it says to do this: const puppeteer = require('puppeteer'); (async () => { await

I have a scope problem in node with puppeteer. i cannot send what is obtained in the evaluate object of puppeteer, because i get: error:

I am trying to get a value from inside page.evaluate() body in my youtube scraper that i've built using puppeteer. i am unable to

I try to write simple web-scraper using puppeteer

I am using puppeteer for web scraping, i need to setup a request interception to read a file that is being downloaded from the browser without

I want to autofill a form with puppeteer. i fill out the first input, then click on a button that then creates a new input field that has

I have this code below made with nodejs + puppeteer, whose goal is to take a screenshot of the user's site: const browser = await

I am trying to write a page's content into a list with puppeteer. my problem is too basic for other solutions out there. the reason i am

I'm trying to scroll an auto loading page , and while doing it i want to fetch the appearing (and disapearing elements). my code looks

I've seen so many posts (for example, see here and

I would like to observe many websites that generate a lot of data. all this using the pupeeter library. my idea is to run 100 containers that

When i access a doi url, it is redirected to the following url.

I am downloading a file through puppeteer into my directory. i need to upload this file to an s3 bucket so i need to pick up the file name. but

I'm attempting to use puppeteer with lambda, however, on serverless deploy, the lambda errors out due to exceeding the 250mb unbundled package

I am running chrome with following arguments- const browser = await puppeteer.launch({ headless: true, userdatadir:

I'm trying to get individual tasks to throw a time-out during stress testing to see what my calling program will do. however, my cluster keeps

This question is based on puppeteer and headless chrome interaction (based on chrome devtools protocol). puppeteer sends json formatted

I have a node.js application which is connected to mongodb. i am retrieving a certain json from my mongodb collection using findone()

I'm experimenting with puppeteer cluster and i just don't understand how to use queuing properly. can it only be used for calls where you don't

I am trying to click a checkbox inside div for the below css selector: #sheet1 > tbody > tr:nth-child(2) > td > div

Const puppeteer = require('puppeteer'); (async () => { const browser = await puppeteer.launch({ devtools: true,

I am trying to click on the "my network" button in linkedin profile. i can use the 'goto' method to go to that url directly but i want to be able

I am trying to type my username on a website but the input box is inside an iframe, i have tried this code to locate the element inside the iframe

Puppeteer opens up a web page and takes a screenshot, how do i push this image value to an sql database? how do i convert the image value

I have the following error handler in a puppeteer script. when ran from node on my computer, it runs fine. however, when ran from

I am trying to login to moz at

I'm running puppeteer via puphpeteer, in one of my laravel 5.8.35 commands. it works perfectly when i run it via the console (e.g. php artisan

On google cloud functions when i try to use puppeteer i get the following error for all sites that i try, an example for google.com:

I have a function: const tabledata = await page.evaluate(() => { const tds = array.from(document.queryselectorall('table tbody

What i want to do is to build a scraping application on nodejs from which it m*onitors on realtime a chat and store certain

I am attempting to use a proxy within my node.js / puppeteer application and receiving errors. if i remove the proxy code, the application

Error in this //2 code. evaluation failed: typeerror: cannot read property 'innertext' of undefined.. i want to crawling website

I'm using tesseract js to convert an image into text format. the conversion is successful and i'm able to print it out in the console. but i am

I'm trying to test an async function using chai.js. it works when i call it from the program but it returns undefined when it comes to

I trying to make a puppeteer.js bot to be able to pause and resume its work. in general, i have a class with a dozen of async methods, event

I tested my xpath selector in chrome dev tools and it finds the <td> i am trying to select. i tried a handful of ways,

Disclaimer: i know that flash will be abandoned by the end of 2020, but i simply cannot drop the case and need to have flash in puppeteer, though

I have made a script in node for web scraping a page periodically as a job and save the data as a object in mongodb. i need to execute the

We have used phantomjs on previous days for generating pdf with server-side prince tool. nowadays we like to change the headless browser from

I have seen that there are functions like page.mouse.down() but it does nothing. do you know any way to scroll?

I'm trying to create a automation on some website with puppeteer and i have a trouble with that when i try to click on element inside select

I'm trying to scrape some web pages in the tor network, using puppeteer and the tor package (apt install tor). probably due to the

I have a scenario where i need to get all social media links from a website. if i consider all the social links are on home page, it is each to

This program works well on puppeteer when i use it on cmd. although, it is a lengthy process and also complicated for any non-technical person. i

When i am on a particular website where i need to initiate a chat and then click on a popup and then once the chat box appear the automation

I am developing a puppeteer script in nodejs. it has an ajax to a load more button in that script. the thing is that, the script doesn't wait for

Sometimes my puppeteer program hangs forever because of an unhandled promise, so i figured i start the program with a settimeout that closes

I tried a few suggestions online but none worked. currently i'm trying this: await page.goto('http://localhost:3000/');

Using puppeteer i'm trying to press the play button of an audio stream element. the element looks like this: <audio

I've been trying to click on a ceratin tab located just above the headers of a big table. that very tab is named and visible as

I got a list of "list items" as elementhandle array and now what i want to do is click on them separately (which will load some more data on the

I've created a script in python using

I've got a short scraper written to pull some titles from a page using puppeteer. while i can scrape individual elements, like a lone h2, trying

I'd like to directly get the response of the last http request shown in the screenshot. the current puppeteer code is shown below. could

We're using puppeteer in a simple node.js application to create screenshots "as a service". we're running this on heroku and quite quickly we see

I am trying to login into my gmail with puppeteer to lower the risk of recaptcha here is my code await

I'm trying to scrape a certain facebook page for its posts written by a certain user and starting with a certain word. const