Browser Fingerprints 🖥️

The fingerprints of your browser is really an important part of web scraping. It will impact how often you will be detected as a bot. The difference between detected or not will be a major factor on your capacity to crawl and extract the data you need.

To reduce these issues, our browsers have been modified to imitate browsers fingerprints used by everyday users on the internet. Those features reduce greatly your chances to be detected as a bot and will increase your web scraping capacity. The goal of the browser fingerprints isn't to be unique, it is to match as much as possible the most common browser configs. If you look like everyone, it is harder to suspect you to be a bot.

How we did it

• We run our browsers in headful mode. The browsers are started with a graphical user interface. Many features are impacted by the headless mode and bot detection systems can detect headless mode.
• The screen resolution used to run the browsers in headful mode is 1080x1920. Don't forget to set your viewport to 1080x1920.
• We added some common fonts to help rendering the web pages.
• No need to use puppeteer-extra-plugin-stealth and similar plugins. The features injected by these plugins are often detected and it flags you as bot.

Code to add on your side

You need to add the following code, or equivalent in your language, to help reduce even more your chances to be seen as a bot.

// CDP can be detected with normal console functions
await page.evaluateOnNewDocument(() => {
    console.debug = () => { };
    console.log = () => { };
});

// Our headful browsers have screen resolution of 1080x1920. 
// If you use the default viewport, it won't match the resolution.
await page.setViewport({
    height: 1080,
    width: 1920,
    isLandscape: true
});

Fingerprints score

To evaluate our browsers fingerprints, we use fingerprints detection websites. Here are some results we got.

CreepJS

The higher the trust score the less chances you have to be detected as a bot.

You can test your trust score here.

Fingerprint Scan

A bot risk score of less than 50 reduce your chances to be detected as sa bot.

You can test your bot risk score here.