Fine-grained parallelism, Raw-disk object store | Intel 1520

Fine-grained parallelism

The appliance uses a highly parallel application that can manage hundreds of thousands of concurrent activities by combining kernel multithreading with an internal scheduling system called Nanothreading.

Raw-disk object store

The appliance stores all cached documents in a custom, high-speed database called the object store. The object store is a streaming database that supports storing alternate versions of the same object, varying on spoken language or browser type.

Alias-free caching

The object store uses content-ﬁngerprinting technology to recognize when two URL addresses refer to the same content, and shares the content copy in cache. Thus, the appliance caches identical content only once. The alias-free cache frees cache space and provides a higher aggregate hit rate for the same cache size.

Fast space reclamation

A space-reclamation algorithm ensures the appliance collects and removes stale data. This garbage collection runs continuously and in real time.

RAM caching

To serve popular objects fast and reduce load on disks, the appliance maintains a small RAM memory cache of extremely popular objects.

Clustering

The appliance uses soft clustering and managed clustering to meet the performance needs of today and to scale to the needs of tomorrow. You can increase the Intel NetStructure Cache Appliance performance incrementally by adding new nodes to the cluster. For more information about clustering, see Clustering‚ on page 140.

Fast DNS resolver

The appliance includes a fast, asynchronous DNS resolver to streamline conversion of host names to IP addresses.

Host database

The appliance maintains a database of information about

✔Internet hosts

✔DNS information

✔HTTP versions of hosts

✔Host reliability and availability information

For information about how you can conﬁgure the host database, see Using the Host Database page‚ on page 44.

144Intel NetStructure Cache Appliance Administrator’s Guide

Image 156

Intel 1520 manual Fine-grained parallelism, Raw-disk object store, Alias-free caching, Fast space reclamation, RAM caching

Contents

Intel NetStructure 1520 Cache Appliance Copyright 2000, Intel Corporation. All rights reserved Contents Configuring the Appliance Using the Command-Line Interface Troubleshooting Problems 109 Error Messages 151 Changing network address configuration on the NIC Contents 106 Preface Who should read this manual Conventions used in this manualConvention Purpose Bold Chapter Introduction What is an Intel NetStructure Cache Appliance? Why use this caching appliance?Flexible cache architecture Web proxy cache Intel NetStructure Cache Appliance features Secure, single-point administration Multithreading process supportHigh-speed caching Broad protocol support How to use this guide Snmp Network ManagementPerformance reporting To find out about … See …Page Getting Started Controls and physical features on your system Starting the system for the first time Command-line interface‚ on Hhmmss Getting Started Accessing the Manager UI Using Monitor and Configure mode Dashboard Monitor mode frame Configure mode frame Using online help Accessing the command-line interfaceChanging passwords Verifying that caching worksPage Monitoring Appliance Performance Accessing monitor pages Using the Dashboard Resolving alarms Dashboard alert lightsExposing node detail Alert light Condition Description Using the Node Changing the selected node Using the Graphs Using the ProtocolsUsing the Cache Using the ARM Using the Other Using the Mrtg Configuring the Appliance Accessing configure pages Using the Server Basics Setting general options NetStructure Cache sectionOption Description Setting Web management options Setting virtual IP addressing optionsUsing virtual IP addressing for node failover What are virtual IP addresses? Adding entries to the Virtual IP address list Setting browser auto configuration options Setting throttling of network connectionsConfiguring load-shedding Enabling Snmp agents Configuring Http Option Definition Configuring Nntp Name and port see Option Definition Configuring FTP FTP Cache activation Storage Freshness For IMS If Modified Since revalidation requests Variable content Following table describes the variable conﬁguration options Using the Security Using the RoutingLink displays the Change Administrator’s Password Setting Http parent caching options Setting ICP options Establishing ICP peers Field Description Setting server accelerator options Option Description Using the Host Database Checking transparencyChecking Wccp Configuring the host database Another invalid hostname message to the user Configuring DNS Using the Snapshots Reaching the Snapshots Using the Command-Line Interface Starting the command-line interface Using the appliance after initial start-upStarting the appliance the first time Navigating the command-line interface To do this Do this Using the setup menu Changing network addresses configuration Changing the controller speed and transmission mode Changing the DNS address and domain nameChanging the gateway address Configuring time zone settings Configuring date and time settingsViewing current network address settings Using the main menu Checking the status of the Server and Manager Starting the applianceStopping the appliance Installing a new version of the appliance software Viewing and maintaining versions of the software Application upgrade Patch upgrade OS/Application upgradeRunning a different version of the appliance software Clearing statistics Deleting a version of the appliance software Rebooting the System Halting the System Resetting to factory settings Using the config menuPreparing a cache disk Setting general controls Configuring protocol options Configuring Http options Configuring Nntp options Conﬁguring Nntp servers Following table describes the tags you can use in a rule Tag Description Tag Description Examples Conﬁguring Nntp access Following table lists the access directive options If access is Authenticator is User is Pass is Configuring Secure Socket Layer SSL port Configuring FTP options Setting filter rules Primary Destination Allowed Value Secondary Specifier Allowed Value Action Value Setting remap rules Target Configuring the cache Enabling caching for different protocols Setting disk storage options Setting object freshness options Following table shows the options Configuring caching rules Request URL method use one of the following Destip=112.12.12.12 scheme=ftp action=never-cache Configuring security options Controlling client access to the appliance Controlling access to the Manager UI Configuring routing options Configuring and maintaining ICP peersViewing and modifying ICP rules Following table describes each ﬁeld Example Mcttl Viewing current ICP settings Enabling and disabling ICP Setting the ICP port number Setting the ICP query timeoutEnabling and disabling multicast in ICP Controlling parent proxy caching Secondary Specifiers Allowed Value Action Tag Allowed Value Action Tag Allowed Value Configuring Wccp options Configuring the Adaptive Redirection Module ARM Enabling and disabling transparent redirection Configuring ARM bypass rules Rule Description Bypass rules have the following format Rule Format Configuring the host database options Configuring load-shedding options Option Description Configuring logging options Using the monitor menu Viewing Node statisticsStatistic Description Cache Progress Viewing Protocol statistics Statistic DescriptionNetwork Statistics Description Statistics Description Client Server Statistics Description Operations Statistics Description Queries OriginatingFrom this Node Viewing Cache statistics From ICP Peers Viewing Other statistics Statistic Description Using the expert menu Using the save menu Using the load menuUsing the logoff menu Troubleshooting Problems Rebooting your system Rebooting your system from the CLI Upgrading software Page Caching Solutions and Performance Appendix a Web proxy caching Day in the life of a cache request Ensuring cached object freshness Cache miss Revalidating objects Http object freshness testsExpires header test Last-Modiﬁed / Date header test Default test Deciding whether to serve Http objectsRevalidate rules Configuring Http freshness options Configuring Http revalidation Configuring Http cachability Caching Http alternatesTo cache or not to cache? Transparent proxy caching Directive source Caching directives Serving requests transparently Interception strategies Using a layer 4-aware switch to filter transparency requests Using a WCCP-enabled router for transparency Using policy-based routing to filter transparency requests Using a router to ﬁlter Http requests ARM redirection Adaptive interception bypass Appliance adaptive bypassMore about bypass rules Configuring bypass options Static and dynamic adaptive bypassSource bypass Destination bypass Server acceleration Advantages of server acceleration How server acceleration worksRetrieving requested documents Whereas the corresponding proxy request would look like this Web server redirects Understanding server acceleration mapping rules Examples of rules and translations User Request Translated Request User Request Origin Server Header Translated Header Understanding cache hierarchies Http cache hierarchies ICP cache hierarchies Miss Nntp cache hierarchies Bombay News article caching Appliance as a news server Appliance as a caching proxy news serverSupporting several parent news servers Blocking particular groups ClusteringSeveral news servers supplying the same groups Several servers supplying different groups Maintaining the cache updates and feeds TransparencyPosting Pull the overview information for speciﬁed groups Configuring Access control Pull the articles for speciﬁed groupsDynamically subscribe to speciﬁed groups Take a partial feed push for speciﬁed groups Self-tuning DataFlow core Obeying Nntp control messagesClient bandwidth throttling Carrier-class architecture Fine-grained parallelism Raw-disk object storeAlias-free caching Fast space reclamation Alarms Advanced protocol featuresHigh-availability Fast kernel packet engine Virtual IP failover Monitor Dashboard Node fault tolerance Expansion capabilitiesLoad shedding Centralized administration Client ACL Page Error Messages Appendix B Html messages sent to clients Title Code Description Appendix B Error Messages 153 Standard Http response messages Message Description Appendix B Error Messages 155 Page Glossary DNS ISP POP Wccp Page Index News server features