ADIF File Processor (ADIFProc)

Download ADIFProc now

Table Of Contents

Introduction
System Requirements
Installing ADIFProc
Uninstalling ADIFProc
Menu

File

Open File To Process
Save Selected File To
Upload Selected File to eQSL.CC
Save Errors To
Exit

Tools

Options

Input File Type Panel
Actions Panel
Check Syntax Panel
Output Panel

Edit Passwords
Edit CSV Fields

Help

Contents
About

Progress Window
Results Summary
What If Errors Occur
Copyright Notice/Disclaimer
About W3ZJ

Introduction

ADIF (Amateur Data Interchange Format) is used to transfer amateur log data between different logging programs and is also the format used to upload log data to eQSL.CC. It can also used to prepare files for submission to ARRL’s TrustedQSL program prior to uploading to LoTW.

While the ADIF specification does a good job of defining a basic standard format for data exchange between different logging programs, it doesn’t go far enough to completely satisfy the needs of on-line QSL services such as eQSL and LoTW. In order to match QSO log data entered by radio amateurs around the world these services need to impose some additional content requirements. For example, if one person enters SSB as a transmission mode and another enters USB or A3, or any of hundreds of other possible variations, the QSO matching programs will never be able to figure out that these two people are talking about the same transmission mode. To resolve this problem both eQSL and LoTW define additional content requirements  on top of the basic ADIF specification. Unfortunately, many logging programs are not aware of these add on requirements and can’t enforce them This can lead to failed log uploads.

A list of electronic logging programs that have successfully uploaded data to eQSL.CC is available at list of loggers. Their presence in that list is not an indication that they enforce proper eQSL data content but merely that they have successfully uploaded data. The statistics in that listing will give you an idea which loggers have been most successful but all have had some failures that are most likely due to inappropriate data values being entered by the user.

ADIFProc can examine the contents of your log, determine if there are content problems and in many cases automatically correct the discrepancy. If ADIFProc cannot automatically correct the problem it will display an error message and skip the log record so that the rest of your log can be uploaded successfully.

Note that the TrustedQSL program that is required for uploads to LoTW also does this type of content checking and thus ADIFProc will address only eQSL requirements.

ADIFProc has many other useful features such as:

  • Automatically uploading your log to eQSL without requiring you to log on and access the upload page.

  • Splitting a large log into several smaller files if you choose to use the manual upload process and want to improve your chances of a successful upload.

  • Reducing the size of your log file by eliminating log data that is not imported by eQSL. This can cut the time required to upload your files  by as much as 200% and by it’s very nature also increases your chances of a successful upload

  • If you have entered both frequency and band in your log, verifies that the frequency matches the band and if not, issue a warning

  • Verifying that a frequency you have specified is within a legal hem band.

  • If either RST sent or RST received is missing from you log, insert a default 59 or 599 report depending on the mode
     
  • Verifying strict compliance with the ADIF 1.0 or the new proposed ADIF 2.0 specification.

The remainder of this document will guide you through the “how to” accomplish all of these things with ADIFProc

System Requirements

Microsoft Windows: 98, ME, NT-4.0 with Service Pack 6a, 2000 or XP.
Must have installed Microsoft Windows Installer V2.0.
Must have installed Microsoft .NET Framework V1.1

Note that to date ADIFProc has only been tested on Windows XP.Home Edition. Windows XP comes in the box with all of the required software components included. Windows 2000 reportedly also has Windows Installer included. However, if you have not been keeping up to date with Windows Update you may not have .NET Framework. If you are using one of the other operating systems and have not already done so, you may have to download and install Windows Installer and .NET Framework. They are available from Microsoft free of charge. This program is written in Microsoft’s Visual C# .NET and according to Microsoft it should run on all of the platforms mentioned above.. The author would appreciate hearing about your experiences with the other systems so that this note can be updated.

Installing ADIFProc

Click here to download ADIFProc If you click “Open” (recommended) in the dialog that appears, ADIFProc will be installed automatically with a shortcut on your desktop and in your “Start->All Programs” list. If you decide to click “Save” instead, choose a convenient folder to save the setup file, then go there and click on “ADIFProc Setup.zip”. Follow the installer prompts; it should only take a few seconds to complete.

Uninstalling ADIFProc

To uninstall ADIFProc go to your Control panel, select Add/Remove programs then select ADIF Splitter and click the Remove button.

Menu

File

Open File To Process

Before selecting this item, you should visit the Options item in the Tools menu to be sure all options are properly set

Clicking on this item will bring up a File Open dialog box allowing you to select the ADIF file to process. As soon as you have selected a file ADIFProc will immediately begin to process the file in accordance with the options you have selected. A progress window will open to keep you informed as the program proceeds toward completion.

Save Selected File TO

When ADIFProc processes an ADIF file it creates one or more output files in a temporary folder and lists the filenames in the temporary file list. These temporary files are removed from the system when you close ADIFProc. You may want to save these files more permanently. To do that click on one of the file names to select it, then go to the File menu and select “Save File To”. A Save dialog box will appear allowing you to choose the folder in which to store the file. “Save Selected File To” is only available when a filename has been selected in the temporary file list.

Upload Selected File to eQSL.CC

If you choose to upload your files manually to eQSL.CC, do the following.:

1.      Log on to your account at eQSL.CC and select “Upload ADIF Log”. Ignore the notes regarding files of more that 1000 records, it can easily handle 5000 or more records.

2.       Click on a filename in ADIFProc’s temporary file list.

3.       In ADIFProc’s File menu select “Upload Selected File to eQSL.CC”. This will copy the selected filename to the windows clipboard and pop up a little dialog asking if your upload completed successfully –Don’t answer that right now, you haven’t uploaded anything yet!

4.      On the eQSL upload page, scroll down to the filename text box. Right click in that box and select “Paste”. The filename on your clipboard will be pasted into the eQSL text box.

5.      On the eQSL page click “Upload it” and wait for the upload to complete. Don’t pay any attention to the time estimate given by eQSL, it will go very much faster than the estimate.

6.      When the upload is complete answer the question in the little dialog box mentioned in step 3. If you choose “Yes”, the file you just uploaded will be deleted from the temporary file list. If you click “No” the file will remain in the temporary file list giving you an opportunity to try again.

7.      If there are still more files in your list, select another one and repeat steps 3 through.6. You don’t worry about losing track of which files you have already uploaded because if it’s in the list you haven’t uploaded it yet.

Save Errors To

After processing a file with ADIFProc you may have a list of Warnings and/or Errors displayed. If you would like to save those to a file, select “Save Errors To” from the File menu. This will bring up a Save As dialog where you can select a folder and filename to create a file for your list of errors. Note that this item is only available when there are items in the Errors/Warnings list.

Exit

To exit from ADIFProc select “Exit” in the File Menu or click the “X” on the upper right corner of the ADIFProc window.

Tools

Options

The first things to do after installing ADIFProc is click “Tools” and then select “Options….”. The Options dialog will appear.

 

Input File Type Panel

The only thing you can select in this version of ADIFProc is “ADIF”.  The other grayed out options are placeholders for a future release.

 

Actions Panel

·        Split: (default is not checked) If you have a large ADIF file that you want to upload manually, selecting this option will enable you to split your file into several smaller pieces. The default size for each file is 5000 log records. Experiments have shown that this size generally works reliably for a foreground upload via eQSL’s ADIF upload page. However, if you have problems with timeout errors you can choose a smaller file size and if your feeling lucky you can try a larger size. See the section entitled Upload Selected File to eQSL.CC for a quick and easy way to manage your split files.

·        Check Syntax: (default is checked) Check this box if you would like ADIFProc to check your ADIF file errors and report them.

·        Correct Minor Errors: (default is not checked) This checkbox is only available when “Check Syntax” is checked. Check this box if you would like ADIFProc to attempt to correct minor errors in your log. This includes such actions as correcting the ADIF field length specifier based on an actual count of the data characters and inserting missing RST values.

·        Auto Upload To eQSL.CC: (default is not checked). This is a powerful feature that will automatically upload your log one record at a time to eQSL and report errors on each record as it proceeds. Because it uses a special set of .NET functions provided by eQSL and uses a multi-threading algorithm to keep several records at a time in the upload queue it runs pretty quickly. The author has seen upload speeds of up to 1000 records per minute on a 45Kbps dialup connection to eQSL.CC. Normally there is no need to split your file if you are going to use this method of uploading. The first time you check this box, a dialog will appear for you to define at least one Callsign and Password for logging on to your account at eQSL.CC. See the section entitled Edit Passwords for more detail on using the dialog box

·        Reporet Duplicates from eQSL.CC:(default is not checked)  This checkbox is only available when “Auto Upload to eQSL.CC” is checked. This checkbox allows you do decide if you want to have duplicate QSO’s listed in the Errors/Warnings list box. Often you know that you will have a lot of duplicates because many of the QSO’s in you log have been uploaded previously In that case you might choose not to have them listed as they will tend to mask the reports of actual errors.

 

Check Syntax Panel

Note these are radio buttons, that is, only one of the choices can be selected at one time.

·        eQSL.CC: (default is checked) Check the data fields for compliance with the eQSL additional requirements such as Modes and Frequencies ets.

·        ADIF 1.0: Check only for compliance with the ADIF 1.0 specification.

·        ADIF 2.0: Check for compliance with the proposed ADIF 2.0 specification. Since this specification is still undergoing changes the rule for this may change. If they do we will update the rules for this test.

 

Output Panel

·        Only eQSL.CC Fields: If this radio button is selected the ADIF file or files that are created by ADIFProc will contain only data fields that are imported by eQSL.CC. This greatly reduces the size of the output files, which saves space, and speeds uploading.

·        All ADIF Fields: All properly formatted fields that exist in the Input file are output whether or not they are in compliance with the selected ADIF specification.

Edit Passwords

When you auto upload an ADIF file to eQSL.CC, (See the Options menu) ADIFProc needs to know the Callsign and Password for the eQSL account you are uploading to. The Edit Passwords dialog allow you to create a list of callsigns and passwords for your eQSL.CC accounts and select one of them as the default. To upload to a different account, simply select the desired callsign in the list and click “Set As Default”. Be very careful with this or you may wind up adding QSO’s to the wrong account.

To add a new callsign and password to the list enter the values into the text boxes at the upper left of the dialog box and then click “Add/Replace”. To correct an error in the list enter the corrected values in the upper left text boxes and click “Add/Replace” To remove a callsign from the list, select it in the table and click “Remove”. When you are finished editing passwords, click “Done”

Help

Contents

Clicking on “Contents” in the “Help” menu will display a copy of this document. Note that if you are reading a section and follow one of the hyperlinks to a different section you can quickly return to the original spot by using your browsers back button.

About


Clicking “About” in the “Help” menu displays a dialog box showing some information about ADIFProc including the current version number.

Progress Window

Whenever ADIFProc is processing a file, a progress window will be displayed on top of the “Results” panel of ADIFProc’s main window. It displays a progress bar and variety of information to keep you informed about how the process is progressing. Note that the time remaining field is an a forecast based on the time that it has taken to process the last few records and the number of records remaining to be processed, it may not always be 100% accurate. If you are processing a very small log file, it is possible that the entire operation will complete before the progress window even has time to open. However, when processing large logs and especially when auto uploading to eQSL.CC this window provides vital information.

If you decide for some reason that you want to end processing early you may click the “Abort” button, which will cause an orderly stop to the processing and close the progress window. The main ADIFProc window will remain open for further operations.

When ADIFProc is has completed its work on a file and the progress information indicares 100% complete, click the “Close” button. This will cause the progress window to close but the ADIFProc main window will remain open.

Results Summary

A results summary is displayed in the top panel of the main ADIFProc window after input file processing has completed. This has two slightly different forms depending on whether you are just processing a file locally or are auto uploading to eQSL.CC.

 

  • Local File Processing: ADIFProc displays the number of “QSO’s Processed”, “Temp Files Crated”, “Corrected”, Warnings”, and “Skipped”. “Skipped” means that there was an uncorrectable error in the data and the record was not copied to the output.
    .
  • Uploading to eQSL: ADIFProc displays the number of “QSO’s Uploaded”, “Temp Files Created”, “eQSL Duplicates”, “Corrected”, “Warnings, and “Skipped”.

    Note that while uploading to eQSL it is possible for timeouts to occur. That is, ADIFProc submitted a QSO to eQSL but eQSL did not respond with a result notification within approximately 10 seconds. When this happens, ADIFProc will show one warning that timeouts are occurring and then retry several times if necessary to resend the data. It is possible that the data was actually accepted on a previous try but the result was not returned in time. In this case the succeeding attempt to resend the data can result in an erroneous duplicate response. Thus, unfortunately when timeouts are occurring, the numbers reported for “QSO’s Uploaded” and  “eQSL Duplicates” will likely be inaccurate.

What If Errors Occur

  1. Don’t worry about duplicates, they are not really errors. That just means that you tried to upload a log entry that was already in your eQSL Outbox. If you want to verify the duplicates, print out the page showing what QSO’s are duplicates and when you are finished uploading, go to your Outbox and look up the duplicate QSO’s, You may have created log entries by confirming a QSO’s on-line or entering them manually.
  2. If an error occurs during a manual upload to eQSL.CC due to a browser time out, click “No” in answer to the question “Did the upload complete successfully” question and try again. Sometimes this can occur due to a temporary slow down of the internet or a temporary problem at eQSL.CC. If this problem persists, reduce the number in the number in the “Number of QSO’s per file” box and start over.
  3. Other types of errors may be listed by eQSL.CC and these will have to be treated in accordance with the error message. If you can’t resolve the problem on your own, write a message to support@eqsl.cc. Be sure to indicate exactly what you are trying to do, what is happening and what error messages you are seeing. .
  4. If you have a problem with ADIFProc itself, please contact rich@w3zj.com and again describe the problem as well as you can.

     Sometimes folks will write in saying “It Doesn’t Work”. That won’t help to solve the problem. We know that the program works under most conditions. It has been tested as thoroughly as it can be with the limited facilities at our disposal. However, testing can only prove when a product doesn’t work, it can’t prove that it does work under all possible conditions. So, if you are having a problem there is something unusual going on and we need to discover what it is. To help us do that you need to describe exactly what you tried to do, what you expected to happen and what actually happened. Also please mention some details about your computer such as speed and amount of ram, what operating system you are using and what Internet browser you are using. You may have discovered a defect that applies specifically to your configuration. Please work with us to track it down and fix it.

Copyright Notice/Disclaimer

This computer program is the property of W3ZJ Software. Copyright law and all international treaties protect it. All amateur radio operators and short wave listeners may copy it for personal use free of charge. Commercial use is expressly forbidden. No warranties of any kind are expressed or implied. Neither W3ZJ Software nor Richard Drake is responsible for any damages that may result from the use of this program.


About W3ZJ

I was first licensed as KN2COR in 1952 at age 12 and later held the callsigns K2COR, W2GAM and N2RD. In 1999 I retired and moved from New Jersey to Southern Maryland with my wife Ruth and stepdaughter Tricia. For a very short time I held the call AA3SZ then applied for and was granted W3ZJ.

For most of my career I worked as a software engineer designing and writing programs in C and C++ on UNIX systems. A while ago I decided to take a look at the new C# programming language. I was duly impressed with the way it streamlined the complex task of Windows programming and solved many of the shortcomings of C++ by making many of the most common programming errors almost impossible to commit. So, I decided that C# would be my new computer language of choice.

 ADIFProc is the first useful program that have produced with C# but it won’t be the last. I have some other things planned as well as some additions to this program. So, keep an eye on the software section at http://www.w3zj.com . I’m now programming for the love of it, not for money.

73, Rich – W3ZJ