Just use changes

Updated version to start adding features but didnt.

A library of tools for manipulating the actual MAL Excel spreadsheet.

A library for the creation and management of the ATT MAL.

First version of a very simple program will take a Relativity saved search criteria report (for now from Lighthouse) and perform a sync-compare between workstream search folders.

Moved the Relativity Search Report program to it's own project folder.

Adjusted the colors on the header to blue.

In this version added the final ability to make the table into a formatted table.

Changed it so that the Workspace control now appears on the same line as the Service Provider control with updated spacing.

Removing client specific names, as this is for all cases.

Changed the file name to be more generic.

This program will assist with the process of performing QC on past and present AT&T privilege logs.

This very simple program will concatenate the fields for the priv description.

This program will take a DAT export from Relativity and turn this into an Excel Spreadsheet Privilege Log.

This very simple program will take a Relativity saved search information export and convert it to a more useful report that can be shared with others and contains
detail contained in the notes section of the search.  This assumes the best practice of notating what the search does in the Notes field.

Added support for looking for duplicate numbers on the attorney and Downgrade tabs and looking for rows where Last name is missing but first name exists.

Adds a new integrity check, by calling this from the Names Norm QC library, that will look for email addresses outside of email address fields in the MAL

Adding some notes as to what it does now and some version information because I'll be adding some additional features.

This version reads from a file with many email addresses and worked perfectly for all of the KLGATES addresses.

Added support for writing the "to Field" or "from Field" information to the issue messages, in advance of possibly making this a single report.  Also going to eventually make this so it itterates over a list and not doing these one by one.

This program performs the various integrity checks on the MAL. This performs the email integrity check that is in the Names Norm class but they does the row integrity check on a local copy of the MAL spreadsheet.  works well so far.

This version adds logic for instances where there is a split role attny but there is no date value in the priv log, which I didnt initially think would ever happen but found instances where it does.  Also adds support for situations where the name cant parse because there are multiple commas in the metadata name value.

Fixed a bug where it was writing more than one non match attempt to the issues.  This was because of that extra else.  This was incorrect and the else belonged at the very end of cycling through the different variations, not during.  Putting this after all the variations have run but still no match fixed the issue.

Fixed an annoying bug where, although I was checking to make sure the first name and last name both exist in the person I'm about to test when I need to match first name and last name only, I was looking at the full list of matching last names, so the report was wrong.

Added the same (except for the text where it says low priority instead of high) split out for split role people to the email failed so lets match names section.  this was copied from the email did match section.  Really need to refactor this code since it has a lot of repeating code.

This version finishes the evaluation on the email address matches split role and reports on the results by adding an issue.  Also added part at end of the email address match section to catch where I can match an email address in the metadata, the person is an attorney, but there is no matching value in the formatted field.  This is a potential missing attorney and it a high confidence flag because I had the email address.

I'm adding some code to work out if a split role attorney was an attorney at the time of the doc date.  I'm just getting it to print out here, so this is not yet complete.

Consolidated all of the additions into the issuesMatrix into a fuction. commented out all the individual adds and tested using the function.  results were identical except for a period in the text that was a typo anyway.

Updated the dates_as_counsel attribute so that it's now a list of two value tuples, instead of just a raw string.  this parsed version will work much better when I attempt to determine if split role attorneys will fall within one of those ranges.  Also updated search_by_email method to search both the work_email_address and the alt_work_email_address, exiting as soon as it finds the first match.  There shouldnt be any duplicates, including the alt email addresses, across rows.

This version adds support for the additionalValuesDict, adding the date value and the legal sources values.

In this pretty substantial update, I added support for the adding information from the split role attorney tab.  I also added methods for searching by the unique row number in the spreadsheets, searching by UUID, and support for searching by any field which results in a list instead of just exiting after finding the first value.  This version adds both the unique row number from the spreadsheet and adds the dates_as_counsel fields to the dataclass.

Now that I make the NamesNormQC a library and I'm not running code in it, I'm able to now call that instead of trying to mirror it here, which was a mess.  Much better.

They changed a column name to 'comments', so updated dataclass. also added some warning messages when the consilio override ingestion cant find a matching email address in the MAL.  I'm seeing many of these.

This version fixes a bug where it wasnt importing the downgrades tab because of an error in missing logic.  Also adds a pseudo private method that does some smarter deduplication in a set because I wanted to make sure I only had unique addresses in the initial RE result, looking for that as an error.  If I have 3 email addresses where only one should exist (like in the from) but they are the same email address, I wanted to make sure I wasnt raising a warning because they are not unique.  if there is more than one unique, that is a warning.  Finally also added support for providing a warning if the override name has a different last name from the MAL for the same record.  I'm now using consilio values for my override but there is concern they could be completely wrong.  So far I'm finding them more accurate actually and not totally off. however still want to be warned.

This program to test searching the MAL.

This very simple program will attempt to locate, using just first name and last name, any names that have been flagged in the past as non-attorneys.

the last updated values from the MAL were giving me issues when trying to save out a pickle file.  I think it's actually reading these as a datetime obj, which is why I get this error.  For now going to comment this out and will add it back in once I have a reason to use it.

This version added some strip due to values in the MAL having beginning or trailing whitespace.

This program will assist with the process of performing Names Normalization QC on the Amazon privilege logs.

I changed the log that records the duplicates in the formatted (not the metadata) field to a matrix so I can see in which field or fields the issue exists.

This version supports deduplicating the metadata fields by using unique email addresses.  Any values that do not have email addresses at all, will stay included but two values in the same metadata field that have the same email address, will dupe out.  This resulted in a substantial drop in mismatches, so apparently the majority of these are where the metadata field has duplicates.

First version of this program that will assist with the process of performing QC on the Amazon privilege logs.  Starting this with the named tuple data structure for now and trying to keep this very readable because I'm sharing the code.

.05 adding excel support

This is the completed version that was used for the final export of the systems.  This includes support for writing to an Excel file.

This version uses a RegEx and is working great.  Need to increase the column count and decide how I want to deal with the output.

First version of a simple program that will, using COM, search an Excel spreadsheet for specific key terms and, if it finds it, will copy the entire row out to a file organized by key term.  This is the first working version but is just too slow.  I think I'm making too many calls to the API.  I'm going to refactor this to see if I can speed it up substantially. 

Added code to mark the batch field as To Confirm UAT or To Confirm LanID.  This made the delivered the v3 report.

This program will open multiple xlsx files, using the Excel COM API, and will perform a simple combining of the data into a single xlsx report.  This version is the first delivered report.

Changed the column name CSV Date to Folder Date and tried adding support for no sorting in the write log method, because the team asked that the Top10Subject lines values be sorted in the spreadsheet by count and not by the subject line value.  These results saved as analysis report v15.

This is the working version that has the final senders values code as well as the unique subject line count code but before I added any top 10 subject line coding was added.

When adding the special senders list where there is no NTRS domain in the TO or where there is but it's not a lanID, I initial started by wanting to have separate per CSV and then a global list.  However diana only needs a single large list but one that references what file it came from and only dedulicates on the file level.  I'm going to change the code for .8 to only have one set, that still only deduplicates on the file level, instead of two.  saving this to version control in the event she asks me to have both.

Per Diana, @EXNTRS.COM is a valid NTRS domain, so changing the NTRS Domain Criteria to now be NTRS.COM, which simplifies that line a bit and will capture anything with that in it.

Very simple program that will read a list of subject lines and deconstruct them to consilidate them into a list of something attorneys
can use to pull out responsive terms.

This version with a working TrueTest method which goes one step further than the RegEx.

This version created the beginnings of the report.  It generates the counts and uses the regEx to pull out all of the ntrs values from the TO line, writing these to a file so that I can look for instances where it's pulling an ntrs but it's not a lan ID one.

a set of functions that I can call which will help me with the 2 ePower disposition projects

A simple program that will read a CSV and perform searches, exporting results and a report

edited to be able to use this file to test the auxilium top level files.  will need to edit this to use the different sources, like going back to service now.

Edited to work on SNOW but doesnt support both at the same time.

Added support for grabbing the Service Now parent change request number too.

Updated to integrate Service Now change request numbers.

general updates

This program will take two CSV files and do a row to row compare.  For this to work both CSVs need to have the same colums.
Set colOmitList to FALSE if you dont want it to parse at all and remove any columns.  for that to work though you have to normalize the date
and number fields.
NOTE: the concur data HAS pipes in it, so verify each report.

This program will inspect and then combine a large set of spreadsheets with multiple tabs of Concur export data.
This is to compare this new merger with a previous merger performed by endo/apks.

This program will take the results from the marked-up table-field report
and export a summary of how many fields are selected as which flag per table.

First working version of this program to extract data from various reports for windows 2008 server analysis.

Running on new exports.

First working version used on 2007backup.
This program will take the results from EndoMultipleTableFieldCompare and will generate a
spreadsheet report so that specific fields can be selected for production.  It will use the
results in the table-field compare and prioritize the tables that are not subsumed to the left
of the workbook and the ones that are to the right, with the idea that you will have a separator tab between them.  It will then highlight in green the rows that were already selected for prod. Be sure to convert the multiple csvs to pipe delimited and NOT utf-16

This program will take a list of tables with the fields contained in those tables
and tell you which tables (fields not data) are subsumed by other tables and which
tables (fields not data) are identical.  This is helpful to get an idea of how the
tables are possibly being used.  Created for use in the Endo case.

Update program to now not only perform single term searches but also multi term AND and OR searches.