The HP-UX IPSec default IKE algorithms are 3DES encryption and MD5 integrity.

At least one Windows security method must match the HP-UX IKE parameters. To change or add IKE algorithms for Microsoft Windows, use the procedure described in “Configuring Windows IKE algorithms.” To change specify IKE algorithms for HP-UX IPSec, use the –encryptionand –hashoptions in the ipsec_config add ike or ipsec_config add ikev1 command.

IKE aggressive mode

HP-UX supports aggressive mode (AM) to establish IKE Security Associations (SAs). IKE AM is an optional feature and is not supported on Windows.

IPsec default transform

The default Windows IPsec transform is ESP with AES-128 encryption and SHA-1 authentication. On HP-UX systems, you must explicitly specify this transform using the –action ESP_AES128_HMAC_SHA1 option in the ipsec_config add host command.

Configuration overview

To configure IPsec on Microsoft Windows Vista and Windows Server 2008 systems, you must complete the following tasks:

1.Configure IKE algorithms, if needed.

2.Configure connection security rules.

3.Configure firewall rules.

4.(Optional) Configure additional IPsec transforms.

Connection security rules specify IPsec parameters, including IKE and IPsec security algorithms, IKE authentication methods and IP address filters for the packets to be secured by IPsec. Depending on the method used to configure a rule, the rule can also specify protocols and port numbers for the filter.

Firewall rules are required to allow inbound and outbound packets when the Windows firewall is enabled. Firewall rules specify a packet filter and the action for packets that match the filter, such as requiring IPsec security to the packets.

Configuring a connection security rule is not sufficient to allow IPsec packets to pass in and out of a Windows system. If you have a connection security rule to secure packets between the local system and a remote system but do not have a firewall rule to allow packets to and from the remote system, the firewall will block the packets.

NOTE: Microsoft Windows Vista and Windows Server 2008 also support IPsec Policy Agent rules. These rules are functionally the same as the IPsec rules on Windows XP and Windows Server 2003 systems and can be configured using the IPsec Policy MMC snap-in as documented in Configuring Microsoft Windows IP Security to Operate with HP-UX IPSec. Microsoft provides IPsec Policy Agent rules for backwards compatibility only and does not recommend the use of these rules on Windows Vista and Windows Server 2008 systems.

Configuring Windows IKE algorithms

The default HP-UX IKE algorithms do not match the default Windows IKE algorithms, so you must configure the IKE algorithms on either the Windows system or the HP-UX system to match the algorithms on the other system.

3