The Search for a Great Tiff iFilter

I recently wrote a VBScript utility that queries the contents of an Indexing Service database, finds the indexed Fax documents (CCITT Group 4 (2d) Tiff's), sorts and moves them to another repository located on a SAN.

Option Explicit
Dim oCon
Dim oCmd
Dim oRst
Dim sQry
Dim sString
Dim sScope
Dim sAqScan
Dim sFile
Dim sPath
Dim sMoveTo
Dim sNum
Dim FSO
Dim sDate
Dim sDosText
Dim sDateDir
Dim sDateDiff
Dim sMonth
Dim sDay
Dim sYear
Dim nCnt


'///////////////////////////////////////////
'
' Create the FSO
'
'////////////////////////////////////////////////

Set FSO = CreateObject("Scripting.FileSystemObject")


'/////////////////////////////////////////////////
'
'   Scope, Aquaius scan dir and Query.
'
'////////////////////////////////////////////////

sScope = "F:\Incoming Fax\CWHHM\"
sAqScan = "F:\Scanned Docs\Aquarius\14CWHHM\"
sQry = "Select Path, Filename, Size, Contents " _
  & "FROM Scope('DEEP TRAVERSAL OF " & chr(34) & sScope & chr(34) & "') "


'/////////////////////////////////////////////////
'
'   Meridian Search and move.
'
'////////////////////////////////////////////////

sString = "Meridian"
sMoveTo = sScope & "Meridian\"
Call ConnectDb
Call MoveIn


'/////////////////////////////////////////////////
'
'   Boise Search and move.
'
'////////////////////////////////////////////////

sString = "Boise"
sMoveTo = sScope & "Boise\"
Call ConnectDb
'Call MoveIn


'//////////////////////
' We will assume the rest
' are Boise documents

Dim sFolder
Dim sFileColl

' ///////////////////////////////////////////
' Set the folder and file collection
Set sFolder = FSO.GetFolder(sScope)
Set sFileColl = sFolder.Files

' //////////////////////////////////////////
' Loop over the direcory of remaining files
' and move them into the moveto dir
For Each sFile in sFileColl
    ' This is needed to avoid trying
    ' to move Thumb.db files where
    ' some usually exist at the destination.
    ' the movefile method will fail in that case.
    On Error Resume Next
    FSO.MoveFile sFile, sMoveTo
    sNum = sNum + 1
Next

Set sFolder = Nothing
Set sFileColl = Nothing


' //////////////////////////////////////////////
'
' Now wait a number of minutes so we can
' query on the DOS
'
' //////////////////////////////////////////////

If sNum < 50 Then
        'WScript.Echo "Sleeping for 5  minutes"
        WScript.Sleep 300000
ElseIf sNum < 150 Then
        'WScript.Echo "Sleeping for 10  minutes"
        WScript.Sleep 600000
ElseIf sNum < 250 Then
        'WScript.Echo "Sleeping for 20  minutes"
        WScript.Sleep 1200000
End If

'------------------------------/////////////// END


'/////////////////////////////////////////////////
'
'   Meridian Date Search and move.
'
'////////////////////////////////////////////////

sScope = "F:\Incoming Fax\CWHHM\Meridian\"
sQry = "Select Path, Filename, Size, Contents " _
  & "FROM Scope('DEEP TRAVERSAL OF " & chr(34) & sScope & chr(34) & "') "
  
  
sDosText = "Date of Service: "
sDate = Pd(Month(Date()),2) & "/" & Pd(Day(Date()),2) & "/" & Year(Date())
sDateDir = Pd(Month(Date()),2) & Pd(Day(Date()),2) & Year(Date())

For nCnt = 1 to 25

' First set the move to location
sMoveTo = sAqScan & "MDN\" & sDateDir & "\"

' Now set the search string
sString = sDosText & sDate

' Now look for the DOS
Call ConnectDb

' And now move them
MoveOver(sMoveTo)

' Reduce the date by one day
sDate = DateAdd("d", -1, sDate)

'Re-pad the date
sDateDiff = Split(sDate, "/")
sMonth = sDateDiff(0)
sDay = sDateDiff(1)
sYear = sDateDiff(2)

sDate = Pd(sDateDiff(0),2) & "/" & Pd(sDateDiff(1),2) & "/" & sDateDiff(2)
sDateDir = Pd(sDateDiff(0),2) & Pd(sDateDiff(1),2) & sDateDiff(2)

Next


'If there are any left, move them into an UNKDOS folder
sMoveTo = sAqScan & "MDN\UNKDOS\"

If Not FSO.FolderExists(sMoveTo) Then
    FSO.CreateFolder(sMoveTo)
End If

' ///////////////////////////////////////////
' Set the folder and file collection
Set sFolder = FSO.GetFolder(sScope)
Set sFileColl = sFolder.Files

' //////////////////////////////////////////
' Loop over the direcory of remaining files
' and move them into the moveto dir
For Each sFile in sFileColl
    FSO.MoveFile sFile, sMoveTo
Next

'------------------------------/////////////// END


'/////////////////////////////////////////////////
'
'   Boise Date Search and move.
'
'////////////////////////////////////////////////

sScope = "F:\Incoming Fax\CWHHM\Boise\"
sQry = "Select Path, Filename, Size, Contents " _
  & "FROM Scope('DEEP TRAVERSAL OF " & chr(34) & sScope & chr(34) & "') "
  
sDosText = "Date of Service: "
sDate = Pd(Month(Date()),2) & "/" & Pd(Day(Date()),2) & "/" & Year(Date())
sDateDir = Pd(Month(Date()),2) & Pd(Day(Date()),2) & Year(Date())

For nCnt = 1 to 25

' First set the move to location
sMoveTo = sAqScan & "BSE\" & sDateDir & "\"

' Now set the search string
sString = sDosText & sDate

' Now look for the DOS
Call ConnectDb

' And now move them
MoveOver(sMoveTo)

' Reduce the date by one day
sDate = DateAdd("d", -1, sDate)

'Re-pad the date
sDateDiff = Split(sDate, "/")
sMonth = sDateDiff(0)
sDay = sDateDiff(1)
sYear = sDateDiff(2)

sDate = Pd(sDateDiff(0),2) & "/" & Pd(sDateDiff(1),2) & "/" & sDateDiff(2)
sDateDir = Pd(sDateDiff(0),2) & Pd(sDateDiff(1),2) & sDateDiff(2)

Next

'If there are any left, move them into an UNKDOS folder
sMoveTo = sAqScan & "BSE\UNKDOS\"

If Not FSO.FolderExists(sMoveTo) Then
    FSO.CreateFolder(sMoveTo)
End If

' ///////////////////////////////////////////
' Set the folder and file collection
Set sFolder = FSO.GetFolder(sScope)
Set sFileColl = sFolder.Files

' //////////////////////////////////////////
' Loop over the direcory of remaining files
' and move them into the moveto dir
For Each sFile in sFileColl
    FSO.MoveFile sFile, sMoveTo
Next

'------------------------------/////////////// END




'/////////////////////////////////////////////////
'
'   First Move Sub
'
'////////////////////////////////////////////////

Sub MoveIn()

' Loop over the query until it is empty
Do While Not oRst.EOF
    sFile = oRst("Path")
    FSO.MoveFile sFile, sMoveTo
    oRst.MoveNext
    sNum = sNum + 1
Loop


End Sub

'------------------------------/////////////// END


'/////////////////////////////////////////////////
'
'   Big Move Sub
'
'////////////////////////////////////////////////

Function MoveOver(sMoveTo)

Do While Not oRst.EOF
    sFile = oRst("Path")
          If FSO.FolderExists(sMoveTo) Then
              'MsgBox "Moving file " & sFile & " to " & sMoveTo & "."
              FSO.MoveFile sFile, sMoveTo
          Else
              FSO.CreateFolder(sMoveTo)
              'MsgBox "Folder " & sMoveTo & " created."
              FSO.MoveFile sFile, sMoveTo
              'MsgBox "File " & sFile & " moved to " & sMoveTo & "."
          End If
        oRst.MoveNext
Loop

End Function

'------------------------------/////////////// END






'/////////////////////////////////////////////////
'
'   Date Formatting function
'
'////////////////////////////////////////////////

Function pd(n, totalDigits) 
   If totalDigits > len(n) Then
       pd = String(totalDigits-len(n),"0") & n 
   Else 
       pd = n 
   End If 
End Function

'------------------------------/////////////// END

'/////////////////////////////////////////////////
'
'   Connection Sub
'
'////////////////////////////////////////////////

Sub ConnectDB()
Set oCon = CreateObject("ADODB.Connection")
Set oRst = CreateObject("ADODB.RecordSet")
Set oCmd = CreateObject("ADODB.Command")

With oCon
    .ConnectionString = "Provider=msidxs; Data Source = IncomingFax"
    .Open
End With

If oCon.State = 0 Then
    MsgBox "Connection failed."
WScript.Exit
End If

With oCmd
    .ActiveConnection = oCon
    .CommandText = sQry & "Where Contains('" & chr(34) & sString & chr(34) & "')"
    .CommandType = 1
End With

With oRst
    .CursorType = 3
    .CursorLocation = 3
    .LockType = 3
    .Open oCmd
End With

End Sub

'------------------------------/////////////// END

Their they sit to later be inserted into a document management program called Aquarius DMS.

I initially installed and was using the MODI (Microsoft Office Document Imaging) package on my file server to utilize the Tiff iFilter it included, but found that it wasn't finding everything I needed it to, so decided to try another iFilter made by Captaris. I was hoping to get better results in their OCR abilities over MODI's.

Unfortunately, the Captaris product didn't improve my results, so I switched back to MODI. No need to spend $300! Yay!

Reblog this post [with Zemanta]

Comments

Post a Comment

Popular posts from this blog

NPI Search Redundancy

Most healthcare professionals know at this point that all providers of health care, require NPI (National Provider Identifier) numbers. Without one, it will become increasingly difficult for claims to be paid by commercial payers, and impossible to collect medicare and medicaid payments. Since we are a coding/billing/collection/management agency, we have frequented the NPPES (National Plan & Provider Enumeration System) to lookup NPI information. Unfortunately, there have been brief periods of downtime of the site, causing us to implement our own solution: a backup of the registry. I have a daily cron job that downloads the NPI database, push it into MySQL, giving us an albeit slow, but accurate access to an off-line version of this data. The shell script below performs the retrieval: #!/bin/sh WORKDIR="/srv/htdocs/npi" LOG="$WORKDIR/npi.log" MONTH=`date +%b` LASTMONTH=`date +%b --date='1 month ago'` YEAR=`date +%Y` URL="http://nppesdata.cms.h
Read more

freeFTPD

Image
Image by Micah68 via Flickr I've been using FileZilla FTP server for some time now and have been happy for the performance. Recently, we needed the ability to expose the FTP service to another client, and the documents that we'd be receiving would be arriving in an un-encrypted form, unlike our other clients. I decided I could simply enable FTPS , the SSL enabled FTP protocol and open a port to 990 on my ASA 5525 Security Appliance and NAT traffic to our server. Unfortunately I quickly found out that a passive FTPS server behind my firewall won't work without some specific configuration changes as discussed in this article . With all that fussing around, I decided to check out freeFTPd, a single deamon that offers both FTP and SFTP, not to be confused with FTPS, but the secure file transfer protocol that is common to the SSH ( secure shell ) protocol. It's fairly straight forward, but is a bit quirky and the documentation is non-existent. Follow some of my ti
Read more

Using ImageMagick and Tesseract to sort TIFFs on Windows

Image
Recently I wrote a post about my search for a TIFF iFilter that would enable me to use VBScript to query a Windows Indexing Services server for file management. I found that since OCR is never always 100% accurate, neither were my attempts at sorting all the inbound EMR faxes we get each day. I did however, find Tesseract , a great product that was originally developed by HP and proprietary, and is now developed by Google and licensed under the Apache License v2, open source . It is one of the most accurate open source OCR engines available. It is quite basic, and in the version you obtain from the project page , it only operates from the command line, and without the libtiff library, will only do it's work on un-compressed TIFFs. More information can be found on the project pages , and Wikipedia . Doing some scouring, I aso found a front-end , and ArchivistaBox, a complete document management system . Image via Wikipedia I'm using it in Windows, so I needed to do one of
Read more