Search 1.0 Deprecation
[Action Required - Breaking Changes]
Censys Search 1.0 is going away - all you need to know and how we can help
In June of 2021, we announced our Censys Search 2.0 and Universal Internet Dataset that provide a new, port-independent data model, a new search language, historical data access, 180x increase in port coverage, and multi-perspective scanning. Read more here.
Censys is terminating products and endpoints affiliated with Censys Search 1.0 and IPv4/IPv4 Banners datasets on November 30, 2021.
tldr:
|
Censys has made massive improvements in the amount of data we’re collecting and making available. We’re saying goodbye to Censys Search 1.0 on November 30, 2021. Specifically, the IPv4 and Domains data. Our certificate data is staying the same, but the API endpoint is moving. |
What help is available?
Glad you asked! Our Customer Success Team is happy to share our resources and work with you on a migration plan to make this smooth as possible so you can quickly start using this new and improved data! We’ll work with you on a two-week engagement where we can regularly check-in and ensure you have answers to any questions.
⭐ The full list of every endpoint that is changing and the available alternatives is available here.
We have reference material available at our Help Center here.
Important Dates:
September 1, 2021
What changes are happening?
To deliver optimal API and UI performance, we are presenting a subset of data available to be searched in the API or UI for certificates that have expired more than one year ago. We call these Censys Lite Certificates. Lite Certificates are the same as our regular certificates, but they don’t have the ct
fields or parsed.extension
fields (see more here) available for searching.
NOTE:
|
You can still view these fields, we just won’t have them indexed for searching. This will not impact the certificate repository for raw downloads or the data presented in BigQuery. |
What do I need to change?
If you actively use the API or UI to query the ct
fields or parsed.extension
fields for certificates that have been expired for more than one year, reach out to support@censys.io and we can talk about alternative ways to access that data.
What happens if I do nothing?
You will not see a service disruption. Upon September 1, 2021, we will start passing the Lite Certificate Data through https://censys.io/api endpoints.
November 30, 2021
What changes are happening?
⭐ The full list of every endpoint that is changing and the available alternatives is available here. Please consult that for all the details!
Here is a summary of changes:
IPv4 Data
- We are updating endpoints to reflect the new https://search.censys.io/api servers.
- IPv4 data available via the UI and API is now called Host Data and it has an updated data schema and search language
- Host Data available in BigQuery (both IPv4 Public and IPv4 Banners) will be terminated in favor of the Universal Internet Dataset, which has an updated data schema
- IPv4 available via raw data downloads (both IPv4 Public and IPv4 Banners) will be terminated in favor of the Universal Internet Dataset, which has an updated data schema and is stored in Avro format instead of JSON
NOTE:
|
Have questions about using Avro instead of JSON? Let us know, we’re happy to share our resources and work with you on a migration plan to make this smooth as possible! Reach out to support@censys.io for more details. |
Certificate Data
- We are updating endpoints to reflect the new https://search.censys.io/api servers.
Domain/Popular Website Data
- We are discontinuing this service. We recommend that users consider Crawler.Ninja as an alternative dataset.
- Name-based scan information will be available to Premium Customers in the host datasets starting in Q4
Other
- API Endpoints for your account information, data series, etc. are being updated to reflect the new https://search.censys.io/api servers.
What do I need to change?
⭐ The full list of every endpoint that is changing and the available alternatives is available here.
What happens if I do nothing?
- On November 30, 2021, you will start seeing 404 errors if you are not using the correct endpoint https://search.censys.io server URLs. We recommend making this change early to prevent service disruption.
- Any queries you had saved for the IPv4 datasets will no longer work unless transcribed to reflect the new data model and search syntax. We recommend doing this early, so you can compare the results while both Search Platforms are live.
- For raw data download customers, if you do nothing, your ETL systems may break if you have not adjusted for the new data model of the Universal Internet Dataset and if you’re not ready to consume Avro formatted files.
Comments
0 comments
Article is closed for comments.