Export as tab-delimited text doesn't work

TalkBug Collectors

Join LibraryThing to post.

Export as tab-delimited text doesn't work

This topic is currently marked as "dormant"—the last message is more than 90 days old. You can revive it by posting a reply.

1supersidvicious
Sep 22, 2010, 9:07 am

I get a small excel file with chinese characters

2lorax
Sep 22, 2010, 11:08 am

Same thing. This is a serious bug.

3supersidvicious
Sep 22, 2010, 11:30 am

畑牥⁹潮⁴桳牡敤⹤匠䱅䍅⁔Ⱚਠउ氉⸱慬杮湟浡⁥十氠弱慬杮湟浡ⱥऊउ㉬氮湡彧慮敭䄠⁓㉬江湡彧慮敭ਬउ氉⸳慬杮湟浡⁥十氠弳慬杮湟浡੥उਉउ!

4AnnaClaire
Sep 22, 2010, 11:34 am

Same here (XP/FF):
畑牥⁹潮⁴桳牡敤⹤匠䱅䍅⁔Ⱚਠउ氉⸱慬杮湟浡⁥十氠弱慬杮湟浡ⱥऊउ㉬氮湡彧慮敭䄠⁓㉬江湡彧慮敭ਬउ氉⸳慬杮湟浡⁥十氠弳慬杮湟浡੥उਉउ剆䵏戠潯獫慴正ऊ䰉䙅⁔佊义戠潯瑫瑩敬ੳउ伉⁎潢歯彳楴汴楥⁤‽瑢歟祥ऊ䰉䙅⁔佊义愠瑵潨獲江੦उ伉⁎潢歯彳污彦摩㴠愠晬楟੤उ䕌呆䨠䥏⁎潢歯慳汬ऊउ乏戠潯獫楟⁤‽潢歯慳汬楟੤उ䕌呆䨠䥏⁎潢歯敲楶睥ੳउ伉⁎潢歯彳摩㴠戠彲潢歯摩ऊ䰉䙅⁔佊义戠潯牫癥敩彷整瑸ऊउ乏戠彲潢歯摩㴠戠瑲扟潯楫੤उ䕌呆䨠䥏⁎慬杮慵敧潣敤⁳十氠਱उ伉⁎潢歯彳慬杮㴠氠⸱慬杮损摯੥उ䕌呆䨠䥏⁎慬杮慵敧潣敤⁳十氠ਲउ伉⁎潢歯彳慬杮′‽㉬氮湡彧潣敤ऊ䰉䙅⁔佊义氠湡畧条捥摯獥䄠⁓㍬ऊउ乏戠潯獫江湡彧牯杩湩污㴠氠⸳慬杮损摯੥उऊ圉䕈䕒戠潯獫畟敳湲浵㴠ㄠ㠹㠰ਸउ剏䕄⁒奂戠潯獫楟


Does this have anything to do with the downtimes? It worked just fine, say, Friday or so when I exported the contents of my wishlist account.

5AnnaClaire
Sep 22, 2010, 11:37 am

>3 supersidvicious:
On closer inspection, is that mess your entire library? Because you have twice as many books as I do, and your string of Chinese is about a quarter as long as mine is.

6supersidvicious
Edited: Sep 22, 2010, 11:50 am

I copied only the first few books (? Characters…). My full library is the following

畑牥⁹潮⁴桳牡敤⹤匠䱅䍅⁔Ⱚਠउ氉⸱慬杮湟浡⁥十氠弱慬杮湟浡ⱥऊउ㉬氮湡彧慮敭䄠⁓㉬江湡彧慮敭ਬउ氉⸳慬杮湟浡⁥十氠弳慬杮湟浡੥उਉउ剆䵏戠潯獫慴正ऊ䰉䙅⁔佊义戠潯瑫瑩敬ੳउ伉⁎潢歯彳楴汴楥⁤‽瑢歟祥ऊ䰉䙅⁔佊义愠瑵潨獲江੦उ伉⁎潢歯彳污彦摩㴠愠晬楟੤उ䕌呆䨠䥏⁎潢歯慳汬ऊउ乏戠潯獫楟⁤‽潢歯慳汬楟੤उ䕌呆䨠䥏⁎潢歯敲楶睥ੳउ伉⁎潢歯彳摩㴠戠彲潢歯摩ऊ䰉䙅⁔佊义戠潯牫癥敩彷整瑸ऊउ乏戠彲潢歯摩㴠戠瑲扟潯楫੤उ䕌呆䨠䥏⁎慬杮慵敧潣敤⁳十氠਱उ伉⁎潢歯彳慬杮㴠氠⸱慬杮损摯੥उ䕌呆䨠䥏⁎慬杮慵敧潣敤⁳十氠ਲउ伉⁎潢歯彳慬杮′‽㉬氮湡彧潣敤ऊ䰉䙅⁔佊义氠湡畧条捥摯獥䄠⁓㍬ऊउ乏戠潯獫江湡彧牯杩湩污㴠氠⸳慬杮损摯੥उऊ圉䕈䕒戠潯獫畟敳湲浵㴠㈠㌹㈶ਸ਼उ剏䕄⁒奂戠潯獫楟

which is shorter than yours

7MMcM
Edited: Sep 22, 2010, 11:51 am

It actually says
Query not sharded. SELECT *,
l1.lang_name AS l1_lang_name,
l2.lang_name AS l2_lang_name,
l3.lang_name AS l3_lang_name

FROM bookstack
LEFT JOIN booktitles
ON books_titleid = bt_key
LEFT JOIN authors_lf
ON books_alf_id = alf_id
LEFT JOIN booksall
ON books_id = booksall_id
LEFT JOIN bookreviews
ON books_id = br_bookid
LEFT JOIN bookreview_text
ON br_bookid = brt_bookid
LEFT JOIN languagecodes AS l1
ON books_lang = l1.lang_code
LEFT JOIN languagecodes AS l2
ON books_lang2 = l2.lang_code
LEFT JOIN languagecodes AS l3
ON books_lang_original = l3.lang_code

WHERE books_usernum = ####
ORDER BY books_id
but is marked as UTF-16.

8supersidvicious
Edited: Sep 22, 2010, 11:53 am

>7 MMcM:
So you don't understand chinese, it is a font problem and the query is not executed.

9staffordcastle
Sep 22, 2010, 12:30 pm

Tab-delimited export worked fine just before the first down-time, when I backed up both my accounts.

10lorax
Sep 22, 2010, 12:49 pm

I suspect one of the tables hit by the tab-delimited export got sharded in the downtime, but the query didn't, so it's having problems. Not sure why the error message is showing as Chinese, but that's almost certainly a red herring.

11whaebich
Sep 22, 2010, 6:51 pm

I have been experiencing the same problem since yesterday afternoon Australian EST. It also manifested itself a few days ago and then magically disappeared.

Being able to download in this form is crucial to the use of my home database. Are the developers working to fix this bug?

12timspalding
Sep 22, 2010, 10:27 pm

I'll get it tonight. Thanks.

13PaulFoley
Sep 22, 2010, 10:52 pm

While you're at it, Tim, could you please fix the header: the four dates in columns 17..20 are all called "date entered".

14timspalding
Sep 22, 2010, 11:49 pm

Thanks. Will do.

15timspalding
Sep 23, 2010, 2:01 am

All set. Thanks for the help figuring out what the Chinese was.

16supersidvicious
Edited: Sep 23, 2010, 2:17 am

almost perfect now.
Tags column header is missing, should appear before review and after stars.
If a book has no tags associated, an empty value between two tabs is needed, now last 6 fields are not aligned (last columns in excel for books without tags is AA, with AB).
Date entered is not considered by my italian excel as a date format. Would it be possible to export it as YYYY-MM-DD?

17lorax
Sep 23, 2010, 8:40 am

If a book has no tags associated, an empty value between two tabs is needed, now last 6 fields are not aligned (last columns in excel for books without tags is AA, with AB).

That's been a problem for years now.

18supersidvicious
Sep 23, 2010, 10:29 am

Incredible..
A simple If then else can't solve this bug?

19lorax
Sep 23, 2010, 10:40 am

I'm sure it could. They just haven't been motivated to fix it. (Lots of the long-standing bugs aren't necessarily hard to fix, they're just low priority.)

20staffordcastle
Sep 23, 2010, 5:07 pm

Workaround - If you go to your tag page, at the end of the list will be a "tag" for books that have no tags. Give them a placeholder tag, and you're good to go.

21timspalding
Sep 25, 2010, 12:13 am

All set. Anything else to do?

22r.orrison
Sep 25, 2010, 2:15 am

Include collections in the export?

23staffordcastle
Sep 25, 2010, 2:23 am

YES! SO many people would love it if that happened!

24timspalding
Sep 25, 2010, 4:25 am

Done. Thanks.

25justjim
Sep 25, 2010, 4:53 am

Wonderful. Thanks for that one. You sure are on a roll today!

26timspalding
Sep 25, 2010, 5:02 am

I'll pay for it in the morning. :)

27jjmcgaffey
Sep 25, 2010, 7:15 am

Wow! Thanks a million! I got collections, I got collections...

28timspalding
Sep 25, 2010, 7:26 am

I'm going to Disneyworld!

Actually, I am going to Disneyworld. Well, next month.

29jjmcgaffey
Sep 25, 2010, 7:40 am

Enjoy yourself!

30PaulFoley
Sep 25, 2010, 8:27 am

Hm. You changed "ISBN" to "ISBNs" (breaking my importer); the content seems to be unchanged...can it put more than one ISBN in there now?

31timspalding
Sep 25, 2010, 10:19 am

What does your importer do?

32r.orrison
Edited: Sep 25, 2010, 11:49 am

User wwj has reported that ISBNs are blank when he does a CSV export.

33wwj
Sep 25, 2010, 12:03 pm

Export as tab delimited format does include ISBN #, so my problem is not as immediate as it was.

34timspalding
Sep 25, 2010, 12:06 pm

Fixed. Gotta say, I f-ing HATE those export pages. Made in month 1...

35timspalding
Sep 25, 2010, 12:10 pm

Fixed.

36timspalding
Sep 25, 2010, 12:11 pm

The bug so nice, I fixed it twice.

37wwj
Sep 25, 2010, 12:21 pm

I understand some of your feelings, but I also put my cookbooks on Eat Your Books, and that export feature means no double entry.

Thanks and thanks

38timspalding
Sep 25, 2010, 12:23 pm

Oh, you do? Cool.

39lorax
Sep 25, 2010, 1:02 pm

So wait, the shifting problem for untagged books is fixed now? AND we got collections in export?

Happy day!

40timspalding
Sep 25, 2010, 1:11 pm

Your account has been debited.

41bnielsen
Edited: Sep 25, 2010, 3:53 pm

Please debit mine too.

And there's still a couple of fields missing from tab-export: "Copies of a book", "Other author roles" and "Chosen cover image", if you want more reasons to debit us :-)

42jjmcgaffey
Sep 25, 2010, 5:56 pm

Copies is there, I think - the second-to-last column. Yeah, the only book I actually put a 2 in there has it.

But it still only exports the old Other Authors, so no roles and mostly no Other Authors (depending on when you entered the book!). And no covers.

I had to go through and modify my macro that cleans up the TD export so I can import it to my Palm database (HanDBase), to move all the columns over to allow for Collections. But definitely worth the time...

Oh, and while doing so I realized that that weird character (box thingy) in front of the 'book id' header - probably, the first character in the file - is still (or again) there. It's been fixed a couple times, but it's baaaack... I vaguely recall that somebody-or-other said it was because something got duplicated at the beginning of the file? This was at least a couple years ago.

43timspalding
Sep 25, 2010, 5:58 pm

Really? Ugh. Okay, I'm starring this. My psyche can't handle that file today.

44MMcM
Sep 25, 2010, 7:19 pm

45jjmcgaffey
Sep 25, 2010, 7:24 pm

Wow. Your Google-fu is strong (I had exactly no clue how I might find that!). Thanks!

46PaulFoley
Sep 25, 2010, 8:12 pm

What does your importer do?

Translates the tab-delimited export format into a suitable form for import into/update of a local db. It uses the header to drive it so that it doesn't matter if you add new columns, or rearrange them...but renaming bites me :|