How to find website addresses that hide behind main links?

[SJ98]

Hello,

 

We sometimes run into an issue where someone will ask for a website to be unblocked, and we put this through our filtering, but it still doesn't unblock for them. We realise in this case there's a website (such as an advert, or something like that?) that also needs unblocking for the website to work - does anyone know where you can find that for any website?

 

It's like how YouTube has some random ones behind it, like ytimg that you need to unblock so that everything works as expected, if that makes sense?

 

Thanks!

[dmj]

In chrome: Select "developer tools" > Network > Doc.

Reload the page.

[Oaktech]

Inspect the page and have a look, or use a device that's in an unfiltered, or lightly filtered group and see what it's calling out to in the reporting.

[TechMonkey]

Does your filtering have a log or reporting? A live view? Filter by IP of the device and visit, then look at all the filtered results.

Otherwise as dmj said, developer tools.

[SJ98]

Yeah I check the log but it doesn't tell me a lot- I may have a better chance with the dev tools and just checking through each item that is recorded - I just didn't know if there was a better way to conduct it!

 

Thank you

[Oaktech]

You can delve a bit deeper if you need to with wireshark, and it's a fun little experiment which might make you look like a network god in a dire emergency...

 

https://unit42.paloaltonetworks.com/wireshark-tutorial-decrypting-https-traffic/

[sigma]

urlscan.io will give you everything that is pulled into a website. You don't need an account to use it.

 

Another quick methed is to use Firefiox with the NoScript add on. Set the scripts defult to off. Allow scripts for the base domain and see what else it pulls in. You can allow different domains until the site "works" so you can see what you need - which is rarely everything.

 

I am always suspicious of any sites that require ad-tracking to run (KCSIE) and look to recommend alternatives.

[36Degrees]

I've had this many times in the past. My first port of call is HTTP Watch which can be added as an extension in Chrome. It shows you all the websites that it thinks it needs to access and then you can see if some are blocked