Jump to content

You're browsing the 2004-2023 VATSIM Forums archive. All content is preserved in a read-only fashion.
For the latest forum posts, please visit https://forum.vatsim.net.

Need to find something? Use the Google search below.
PLEASE READ - Webmaster Support Forum
This forum will be retired in the near future. Please direct all queries to our dedicated GitHub support page https://github.com/vatsimnetwork/developer-info/discussions 
Here you can find documentation on our services and we are continuing to migrate pertinent information into the Wiki pages https://github.com/vatsimnetwork/developer-info/wiki

Missing robots.txt on datafeed servers

Bradley Grafelman

By Bradley Grafelman,
in VATSIM Webmasters

 Share

Recommended Posts

Bradley Grafelman

Bradley Grafelman

Posted
Posted

None of the current datafeed servers (as well as status.vatsim.net and metar.vatsim.net) have a robots.txt file that at least attempts to disallow crawling of the relevant auto-updated text files.

 

Given that many are quick to point to bandwidth savings as the justification for a number of topics, it seems odd that this is so. Is this intentional?

Link to comment
Share on other sites
Daniel Hawton

Daniel Hawton

Posted
Posted

AirCharts doesn't have one because I don't disallow it.

Link to comment
Share on other sites
 Share
Go to topic listing