ISSEL Log Companion Pro 4.1.2 Release Notes

Updated 2006-03-14

This document describes installation notes, known issues, and miscellaneous engineering notes for the ISSEL Log Companion Pro 4.1.2.

For a description of the functionality of ISSEL Log Companion Pro 4.1.2, see the ISSEL Log Companion User Guide.

This document describes the following:

  • New in 4.1.2
  • System Requirements
  • Installation Procedure
  • Uninstall Procedure
  • Known Issues
  • Licensing
  • More Help
  • Revision History
  •  

    New in 4.1.2

    These are the news in this release:

    For previous changes and fixes please see the Revision History.

     

    System Requirements

    Windows NT 4, Service Pack 6a, Windows 2000 (Workstation or Server)
    Pentium compatible, 64 MB RAM, 2 GB HD.

    At present the above are the only supported OSes. No problems are forseen with operations on Windows XP, Windows 98 or Win ME, though this is not tested.

    The ISSEL Log Companion Pro has very limited system requirements. When running it will use less then 10 MB of RAM, irrespective of the size of the log files being processed. Clearly, if the programme is set to call other programs (such as Hit List) then requirements will increase accordingly. The Log Companion Pro itself uses less then 2 MB of disk space however the log files it processes can use any amount of disk space so the disk drives should be dimensioned accordingly.

     

    Installation Procedure

    The installer backs up the ISSEL directory (C:\Issel) to the Temp directory before it installs any new files. The backed up directory is called "issel_org". Note: If the Log Companion is ever installed again this directory will be overwritten.

    If you are already using an earlier version of the ISSEL Log Companion you can un-install the old Log Companion before or after installing the new version according to the descriptions below. However, do not delete the ISSEL directory if you want the installer to automatically re-use your previous settings.

    Installation procedure is as follows:

    1. Download the installer application from the ISSEL web site.
    2. Double click the installer file to run the installation program.
    3. The installer consists of three parts:
      • A self-extracting executable. When it opens select Setup. This extracts all the files from the archive to the temp directory and runs a batch file.
      • The batch file creates the directories, backups the ISSEL directory and copies the files to the correct places and then starts the installer for the VB program.
      • The VB installer shows a splash screen. Select Setup. This installs the VB program and its associated files.

    After installing the new software the Log Companion Pro should still be pointing to any customised exclusion- or inclusion-files you were using previously. However, any exclusion/inclusion files you had modified in the ISSEL directory will have been replaced with fresh new files. If you kept your files in the ISSEL directory your old exclusion/inclusion files can now be found in the backup of the ISSEL directory (C:\Temp\Issel_org). For this reason it is a very good idea to move your custom exclusion/inclusion files to separate directories instead of using the ISSEL direcory.

    Every new version of Log Companion Pro comes with the latest Robot Exclusions file from ABC. After installing an upgrade you should change your Log Companion Pro setting to point to the latest version of this exclusion file which can be found under C:\Issel\Exclusions\.

    When a release adds support for a new log file type you should make sure the right log file type is selected in your old configurations. You may need to open every configuration and re-select the Log File Type setting.

    Release 3.2.0 introduced wild cards for IP-exclusions. If you are upgrading from an earlier version of Log Companion Pro you have to edit all your IP-exclusion/inclusion files. Entries which previously did NOT have any trailing wild cards must have the trailing wild cards ADDED to represent the same exclusion/inclusion as before. Without the wild cards they will be taken to mean exact matches. Also note that 3.2.0 offers new combinations for wild cards and IP-ranges, examples of which can be seen in the included default exclusion/inclusion files.

    The installation is now complete and the programme can now be started from the Start menu under Programs/Issel. When you start up the new release of the Log Companion Pro for the first time make sure you examine any new features and select the settings you prefer. Typically any new features will be disabled by default so they should not affect processing unless you want them to.

     

    Uninstall Procedure

    To remove the ISSEL Log Companion Pro from your machine follow these steps:

    1. Open the "Add/Remove" control panel, select the ISSEL Log Companion Pro and remove it.
    2. Delete the directory C:\Issel and all its content. Do not delete the ISSEL directory if you are doing an upgrade.

     

    Known Issues

    On some systems the installer (the CMD window) halts asking for permission to overwrite certain installation files. If this happens you can select ALL to overwite all the necessary files. Only files in the Issel directory are over written. This issue is probably based on the security settings for the account used to install the software.

    If you are not sure what type of log files you have, select the Auto Detect setting which will detect the log file format for you. However, if the log file is a totally unknown format the Log Companion may still treat it as an NCSA log so please check that the output seems valid.

    There is a small problem with handling extra Header fields in IIS log files such as those that shows up when the web server is restarted or the logging configuration is changed. When the Log Companion runs into such a field in the middle of a log file (instead of in the beginning) it will simply exclude such lines. As long as the actual field definitions does not change (for example when a web server is re-started) there are no further problems. If the definition is changed then the rest of the output will probably be garbage since the fields will be parsed according to the original header in the file. To avoid this the log file has to be split where the definition occurs and the different sections of the log be processed separately.
    Note: From version 3.2.0 the Log Companion can handle IIS5 logs which does not start with a proper Web Header if the Log Companion is set to auto detect the log file format (as long as there is a Web Header available somewhere in the log) but will still not detect extra Web Headers after the first has been detected.

    There is an issue with the function converting cookies to parameters. Entered Cookie names which matches the beginning of another cookie name will be parsed if they appear before the intended cookie in the cookie field in the log file.

    The function to load log files into Hit List one at a time does not work properly and should not be used. It is therefore disabled at the moment.

     

    Licensing

    To purchase the ISSEL Log Companion Pro contact ISSEL at sales@issel.co.uk sending the Log Companion Pro ID which can be found under the System tab after you have started the programme. On receipt of your payment you will be sent a License Key. This key can be entered into the Log Companion Pro under the System tab, directly below where the ID is found. On entering a correct license key a confirmation message will appear and the text at the top of the screen will now show that it is a licensed version.

     

    More Help

    This is complex software and as such there may be issues that you will encounter. Please report these to support@issel.co.uk for us to investigate.

    We also welcome suggestions for improvements and new features. These should also be sent to support@issel.co.uk.

    For our contact information please go to: www.issel.co.uk

     

    Revision History

    Release 3.8.2
    Date: 2005-04-04

  • Added function to to merge hourly IIS logs into daily.
  • Added function to summarise all the logs processed in the Event Log.
  • Modified the init-directory for exclusion dialogues to be the same as the last one.
  • Added Special 4 log file type for custom log file format.
  • Added Special 5 log file type for custom log file format.
  • The event log is now more likely to contain messages after a crash.
  • Fixed bug where a modified header would also get written to the bad output.
  • Fixed bug where modified header would not get written to split logs.
  • Release 3.7.0
    Date: 2004-05-17

  • Added function to delete old processed logs.
  • Added function to delete old archived log files.
  • Increased max line length from 1900 to 2400 characters.
  • Added Special 3 log file type for custom log file format.
  • Fixed bug with NCSA log cookie parsing.
  • Release 3.6.0
    Date: 2004-03-09

  • Added function to exclude lines without query strings.
  • Added function to create a Batch File for the current config.
  • Now does not pre-select log file names when browsing for logs.
  • Removed meaningless Read-Only check-box from all common file dialogues.
  • Output and Temp directories can now be selected through a Folder selection dialogue.
  • The Input and Temp directories now gets created automatically if they do not exist.
  • Fixed bug which could sometimes stop the next execution after a stop of a previous execution.
  • Release 3.5.2
    Date: 2004-02-16

  • Added support for IIS6 log files.
  • Added Stop function so that processing can be manually stopped at any time.
  • Added function to optionally split log files after a user selectable number of lines.
  • The output directory now gets created automatically if it does not exist.
  • Release 3.4.1
    Date: 2004-01-16

  • Added option to include only traffic from a particular month and/or year.
  • Added Special 2 log file type for custom log file format.
  • Removed separate 'contype' exclusion as this is nowadays included in the robot list.
  • Updated the list of search parameters.
  • Fixed bug so that empty Robot exclusion file lines does not automatically result in exclusion.
  • Fixed bug so that New from File menu now actually selects the new config file instead of the default.
  • Fixed bug so that no special log file warning is given when a config using a special log type is opened.
  • Fixed bug so that Log File list cannot be edited by user.
  • Fixed bug so that server insertion field is properly enabled and disabled.
  • Fixed bug so that ABC directory message does not show up.
  • Fixed bug so that Exclude/Include list for URL and Query cannot be edited by user.
  • Changed default Hit List application to 5.6.
  • Release 3.3.0
    Date: 2003-12-11

  • Added function to split NCSA logs into days if they cover longer periods.
  • Added more informative status messages during processing.
  • Modified the internal timer to go faster between internal states.
  • Fixed bug with processing extreme lines used by hackers to break web server security.
  • Release 3.2.0
    Date: 2003-10-27

  • Added option to Auto-detect log file formats.
  • Added option to perform Host Copy for NCSA logs.
  • Added keyboard shortcuts to Browse, Edit and View buttons.
  • Added ability to use wild cards with IP exclusions.
  • This also means that exact matches can now be performed.
  • Added ability to match IP addresses using ranges.
  • Added ability to parse NCSA log files with Host Header field.
  • Added ability to parse NCSA log files with extra redundant fields at the end of the lines.
  • Added ability to detect and parse Web Headers in IIS5 logs even if they are not at the top of the file.
  • Changed behaviour so that File Dialogue boxes start in the last visited directory.
  • Fixed crashing bug in processing of ZIP files which are too small (i.e. empty or corrupt). These are now skipped.
  • Fixed bug with leading URL wild card exclusions which could be fooled by matches inside a string.
  • Fixed bug with leading Query String wild card exclusions which could be fooled by matches inside a string.
  • Fixed bug so that Port label is displayed properly.
  • Fixed bug so that tabbing between fields is now in correct order.
  • Fixed bug so that server text field now is enabled and disabled according to Host Copy setting.
  • Fixed bug so that Save As menu item now uses the SaveAs CommonDialog function.
  • Release 3.1.2
    Date: 2003-04-25

  • Fixed bug so that Hit List can now be launched.
  • Fixed bug so that original output file is deleted when output is zipped.
  • Fixed bug so that the archived source file is deleted after the archived log file is zipped.
  • Fixed bug so that Event log gets created if it doesn't exist, instead of resetting it to default value.
  • Changed default Hit List application to 5.0.
  • Release 3.1.1
    Date: 2003-04-22

  • Changed Zip component so that Unix format GZIP files can be unzipped.
  • Release 3.1.0
    Date: 2003-04-17

  • Now able to process zipped log files.
  • Added ability to compress the output log files.
  • Added ability to compress archived source log files.
  • Release 3.0.0
    Date: 2003-02-03

  • Option to exclude User-Agents with 'contype' strings.
  • Modified NCSA parsing to accept lines without either cookie, user-agent or referrer fields.
  • Made it optional to output the Exclusion codes with the bad output file.
  • Increased the maximum length for the entries in the exclusion files from 90 characters to 300.
  • The exclusion files can now be opened for editing from inside the Log Companion.
  • The event file for a configuration can now be viewed from inside the Log Companion.
  • Added screen outputs for events which interrupts the process.
  • Some events are now written to the screen if the event log cannot be written for some reason.
  • Release 2.1.2
    Date: 2002-06-26

  • Preserves the case of the URL file path in the processed log files.
  • Made the parsing of persistant cookies more accurate.
  • More then doubled the maximum length of accepted log lines to 1900 characters.
  • The "Bad" output file now includes an exclusion explanation for every line.
  • Fixed so that Log Companion recognises changes to its files and fixes them instead of crashing.
  • Fixed bug which prevented cookie to parameter conversion in some cases.
  • Release 2.1.0
    Date: 2002-03-15

  • Added support for new log file type NCSA UNIX.
  • Made it optional to exclude requests without protocol field (NCSA only).
  • Made it optional to exclude requests where the URL does not start with a slash (/).
  • Added exclusion counters for the two above in the Event Log.
  • Changed so that exclusion counters only are shown if they have a non-zero value.
  • Fixed bug so that number of header lines are updated when a configuration is loaded.
  • Fixed bug with NCSA cookie parsing which could insert an extra double quote in the field.
  • Release 2.0.0
    Date: 2002-01-02

  • Added Pro to the product name.
  • Added the ability to handle multiple configurations.
  • Added menu system.
  • Added optional eRoom function, see below.
  • Added function to convert eRoom hex codes to decimal codes for query parameters.
  • Added function to convert eRoom hex codes to decimal codes for URLs.
  • Added Application tab.
  • Moved the IIS WinUser bug function from the Transformation to the Application tab.
  • Moved the Hit List integration function from the System to the Application tab.
  • Now allows file paths with spaces for logs and configurations.
  • Changed how the Log Companion communicates internally.
  • Added short help comments to each tab.
  • New graphics and layout details.
  • Release 1.6.0
    Date: 2001-09-03

  • Updated the installer to re-use previous settings from earlier Log Companion installations.
  • Added function to only keep selected parameters.
  • Added function to only keep selected source parameters.
  • Modified the function that inserts server names in the s-ip field.
  • Fixed bug whith changes to Exclude/Include query strings.
  • Fixed bug with enabling transform text fields after log file type selections.
  • Fixed bug in the license code system.
  • Fixed bug which wouldn't terminate lines properly.
  • Moved the licensing information to the form caption.
  • New graphics and layout details.
  • Changed all Netscape references to NCSA/Apache.
  • Release 1.5.1
    Date: 2001-07-16

  • Fixed so that cookie functions can only be selected when IIS4 or IIS5 is the selected log file type.
  • Fixed bug which prevented more then one cookie to be converted to parameters.
  • Fixed a bug with processing cookies without values in the last position of the cookie field.
  • Fixed potential bug which prevented cookies after a persistant cookie to be converted to parameters.
  • Release 1.5.0
    Date: 2001-06-22

  • Added function to exclude requests based on Query Strings.
  • Added function that checks any selected files since the Log Companion cannot handle spaces in file names.
  • Fixed potential bug in cookie transformations.
  • Release 1.4.0
    Date: 2001-06-11

  • Added option to keep only the value of the persistant cookie in the log file.
  • Added option to convert cookies to parameters.
  • Added option to fix bug with Windows Authentication in IIS servers.
  • Changed the functionality of the Verbose logging option for the Log Companion. Stats are now always included.
  • Release 1.3.0
    Date: 2001-05-17

  • Fixed a minor bug with clearing the number of control-character exclusions in the Log Companion Event Log.
  • Fixed a bug which would exclude IIS4 or IIS5 lines which did not have all possible fields.
  • Changed the function which excluded HEAD requests to instead allow the inclusion of only GET and POST requests.
  • Added function to replace the Port Number in IIS log files.
  • Release 1.2.4
    Date: 2001-03-18

  • Fixed a Carriage Return bug which made it impossible for Hit List to read IIS logs processed with the Log Companion.
  • Release 1.2.3
    Date: 2001-03-05

  • Log files read in binary mode.
  • Option to exclude request lines with Control characters.
  • Release 1.2.2
    Date: 2001-03-03

  • All URL file paths must now start with a slash "/" or the line gets excluded.
  • Now excludes lines which does not have all the fields they are supposed to have. This removes the problem of parsing incomplete lines.
  • Now possible to select Verbose Event log output without having to select to output the bad log data.
  • New option to Exclude lines where the User-Agent field is empty, per the ABC standard.
  • Release 1.2.1
    Date: 2001-02-15

  • Fixed bug with very long Robot exclusion fields.
  • Fixed cosmetic bug with colours in activity fields.
  • Added support for IIS5 log files.
  • Rewrote the parser for IIS4 and IIS5 to be more effective.
  • Fixed so that the User-Agent exclusion list is used with plus-signs instead of spaces internally for comparisson with IIS4 and IIS5 logs.
  • Added function to copy the Host Header field to the Server field for IIS5 logs.
  • Added wild-card support for URL exclusions/inclusions.
  • Release 1.1
    Date: 2001-01-16

  • The only difference between 1.1 and 1.0 is that 1.1 allows you to Exclude or Include requests based on URLs. 1.0 only allowed to Exclude based on URLs.