The Portable Freeware Collection Forums

SYSTEM wrote:The dump script now produces invalid CSV. The double-quote character is missing at the end of the size field.

@SYSTEM: puppy's teething trouble...(nothing that a gentle touch of DB dusting wouldn't fix)...

Nirsoft's handy CSVFileView to the rescue:

• sorting on TPFC.CSV's new column shows exactly 17 records (out of 2,042) affected by the "missing quote" syndrome.
  (actually, there shouldn't be any quote at all in there)
• sorting again on the new column shows a further 10 records include alphabetic strings instead of numeric value in the new field
• those same 10 records also have an extraneous column appended...
• one of those 10 records, namely #1665, even has two additional columns appended, for good measure...

I suspect those freshly uncovered anomalies should be easy enough to rectify, thereafter restoring our prize DB forever back to its pristine condition ?

Further suggestions to Andrew : (if not pushing my luck too far...)

• 1. Perhaps a "Size" header for the new column would be appropriate icing on the cake ?
  2. Maybe the "Size" column could be defined as a numeric field entity, so as to preserve numbers formatting alignment ?

Thanks @SYSTEM for his pertinent observation, and of course @Andrew for a blindingly fast implementation !

__philippe wrote:Nirsoft's handy CSVFileView to the rescue:

• sorting on TPFC.CSV's new column shows exactly 17 records (out of 2,042) affected by the "missing quote" syndrome.
  (actually, there shouldn't be any quote at all in there)
• sorting again on the new column shows a further 10 records include alphabetic strings instead of numeric value in the new field
• those same 10 records also have an extraneous column appended...
• one of those 10 records, namely #1665, even has two additional columns appended, for good measure...

All fixed, tested using CSVFileView. The missing end-quote on the size field, and the missing "Size" header were stupid errors on my part, attributed to over-confidence and lack-of-checking.

The quote-in-description problem has always been there but has never been pointed out. Easy to fix by escaping each quote with another quote.

Andrew Lee wrote:

__philippe wrote:Nirsoft's handy CSVFileView to the rescue:

• sorting on TPFC.CSV's new column shows exactly 17 records (out of 2,042) affected by the "missing quote" syndrome.
  (actually, there shouldn't be any quote at all in there)
• sorting again on the new column shows a further 10 records include alphabetic strings instead of numeric value in the new field
• those same 10 records also have an extraneous column appended...
• one of those 10 records, namely #1665, even has two additional columns appended, for good measure...

All fixed, tested using CSVFileView. The missing end-quote on the size field, and the missing "Size" header were stupid errors on my part, attributed to over-confidence and lack-of-checking.

The quote-in-description problem has always been there but has never been pointed out. Easy to fix by escaping each quote with another quote.

Thank you.

Andrew Lee wrote:...All fixed, tested using CSVFileView.
The missing end-quote on the size field, and the missing "Size" header were stupid errors on my part, attributed to over-confidence and lack-of-checking.
The quote-in-description problem has always been there but has never been pointed out. Easy to fix by escaping each quote with another quote.

Andrew rules

All fine and dandy now...

One nice feature about using CSVFileView is the sort-within-sort capability, for instance :

• select "Categories" (click header) as a "Primary" sort column, and then,
• select "Size" (shift+click header) as a "Secondary" sort column

thus displaying all Apps sorted by Size within a specific Category..., nifty !

Thanks again to Andrew for fixing the tpfc.csv file anomalies.

Cheers,

__philippe
_________________
PS
The DB dump file can also be imported into an Excel sheet, thus allowing to format the Size column entries as numeric values,
complete with right-aligned, comma-separated numbers, which, I gather, cannot be formatted right into the source tpfc.csv ?

The DB dump file can also be imported into an Excel sheet, thus allowing to format the Size column entries as numeric values,
complete with right-aligned, comma-separated numbers, which, I gather, cannot be formatted right into the source tpfc.csv ?

AFAIK CSV is a text format and does not cater for formatting and alignment.

@Andrew,

And right you are, of course, I should have thought about it before posting drivel...

Anyway, it's just as well Nir Sofer does cater nicely for this kind of situation :
(From the CSVFileView help file) :

"If the column values are numeric, CSVFileView automatically makes a numeric sorting instead of string sorting."
...
"Automatic Numeric Sorting:
When this option is turned on, CSFileView automatically uses numeric sorting when numeric values are detected".

Other CSV utilities (such as CSVedit) , powerful as they may be, are not so considerate in this specific case:
numeric contents or not, your columns get sorted as strings, willy-nilly.

I'll gladly stick with the tpfc.csv as it stands now, thank you very much...

__philippe wrote:...
Anyway, it's just as well Nir Sofer does cater nicely for this kind of situation :
(From the CSVFileView help file) :

"If the column values are numeric, CSVFileView automatically makes a numeric sorting instead of string sorting."
...
"Automatic Numeric Sorting:
When this option is turned on, CSFileView automatically uses numeric sorting when numeric values are detected".

Besides, it's just as well Nir does, occasionally, consider some (unidentified) user's trifling update suggestion ...
...and thereby quietly oblige :

CSVFileView v2.31 (released 16-APR-2017) - New in this version:

• [*]Added 'Align Numeric Columns To Right' option (under the Options menu).

Goody, goody...

Nirsoft relevant news, belatedly...

CSVFileView v2.32 (released 10-MAY-2017) - New in this version:

• Added 'Add Thousands Separator' option (Under the Options menu).

CSVFileView will now neatly display "Right-aligned AND Comma-separated" numeric values...

Exeunt Excel behemoth and runner-up CSVed (right-alignment not supported)...

... thanks again to Nir...