Censys Universal Internet Dataset Download Release and Timeline FAQ
Answers to commonly asked questions about downloading the Censys Universal Internet Dataset.
The Censys Universal Internet Dataset is the most comprehensive Internet-wide data collected from scan in the industry.
This dataset is composed of 4 downloadable data sets: IPv4 hosts, IPv6 hosts, IPv4 virtual (in other words, name-based) hosts, and IPv6 virtual hosts.
The existing 4 downloadable series that make up Censys Universal Internet Dataset are being replaced.
They contain the same information, but are now encoded using Google’s BigQuery Avro Export Format.
The schema in each series is unchanged from its deprecated counterpart, although 1 data encoding is improved from the previous datasets, and default values are more compliant with strict decoders.
It hasn’t.
The encoding of timestamp fields changed from a string to a long, annotated as a timestamp-micros logical type.
Other encodings remain the same but are now entirely compliant in setting safe default values (for example, Previously, 0 was set as the default value for latitude, but strict decoders want a default of 0.0).