In Products:
Web Filter
Bloxx Web Filtering is the only true real-time Web content filter; it performs live analysis and real-time categorization of Web pages to dramatically improve protection and security.
Latest Internet Statistics
| This month's web stats: | ||
|---|---|---|
| No. indexed web pages | No. new domains last month | No. active domains |
| 19.07bn | 149k | 226m |
Sources: Netcraft and World Wide Web Size |
||
How Big is the Internet?
Have you ever asked a group of engineers how big the Web is and been bamboozled by domains, indexed pages, hostnames and a whole lot more? Have you wondered why that is?
Well, when the Web was invented and there were just a few hundred websites it may have been possible to give an accurate answer, but it's now so vast that it’s almost impossible to accurately measure how big it is.
That’s why a range of different stats are now routinely used to illustrate the size of the Web and to help you we list some current statistics on our site.
Why is the Size of the Web Significant to Web Filtering?
First and second generation web filters mainly rely on a database of URLs. When a user requests a website, the web filter checks the URL against the database list to determine what type of site it is, then either blocks or allows access based on the usage policy. A typical URL database will usually hold 20 to 30 million URLs.
When the Web was relatively small this approach worked, but now that the Web is so vast, a URL database can only cover a small part of it and can’t keep up with its dramatic growth.
With the URL database approach, you need to consider how to handle unclassified URLs. Do you block them entirely or allow universal access to all of them?
Block them entirely and you over-block users; deny access to useful information and receive endless requests to have websites added to the allowed list which can burn up your valuable time.
Allow universal access and you increase network security risks, leaving users with the ability to view inappropriate content and expose your organization to legal liabilities.
Thankfully, with Bloxx Tru-View Technology Web filtering, this is a thing of the past.