Import not working?

I imported a CSV file with 48 books in it, last night. No ISBNs, a couple duplicates with books I already have, but mostly importing the text in the file. Nothing has shown up in my library in nearly 24 hours. Does the queue need kicking again?

Related - is there any way I can see progress (or lack of same) on those books? I can go look at the queue, but that's a queue of the ISBNs which I deliberately remove so that what gets entered is my chosen data (which is to say, it remains 0 in the queue at all times).

I'm perfectly willing to re-import - but not if the previous file will then get kicked loose and give me duplicates. Suggestions?

I've been noticing this the last couple of weeks as well. It's been a while since I did much importing. I notice they hang at night. Some times they add 3-4 days later. Sometimes never. I've wondered if some sources close down at night? Alway have no ISBN, and typically use Overcat / LC / Prospector. Wonder if LC closes at night.

Still nothing 6/29, 48 hours later.

Wonder if some server in LT's array shuts down overnight...

>1 jjmcgaffey: I'm taking a look and asking for @ccatalfo's help! I don't see any stuck imports, so there might be something else at play. Your import is showing up as still processing, which is odd.

Okay, I guess it is getting stuck in the processing stage, we'll need to dig deeper. Hold, please. (Resubmitting the import will likely not help.)

OK, thanks!

I don't _think_ there's any weird characters in there, but there may be.

>6 kristilabrie: Having this same issue intermittently. Had a batch of 10 go through at 7:27 pm PDT on 6/30/23 but my second batch about 30 mins later is hung. Like the OP, they are all no-ISBN works, so nothing shows in the queue. Thanks.

>8 CtrSacredSciences: Thanks for the info. For the import that was successful, were they also non-ISBN works?

>9 kristilabrie: Yes all non-ISBN. I have three batches hung now. 10 items, 9 items and 35 items.

>9 kristilabrie: Should I just upload them again? Thanks.

>11 CtrSacredSciences: I don't think that will help at all, @ccatalfo is going to try to do some digging in the next week or so to nail this down! We'll post here with any updates. I appreciate your patience in the meantime.

Hi, I'm also having problems with importing from Goodreads: I tried the first time on June 27, but nothing happened. So I tried again on July 9, but the library is still empty.

>13 lasiepedimore: Thanks for the report, we'll take a look.

Is it still processing? I've got another batch I want to put up. Any progress?

>15 jjmcgaffey: It's still stuck at processing, and @ccatalfo is out today so I can't get an update from him. You can probably try to re-import your file, and/or upload a new one, to see if that goes through. Let us know what you get, if you can, and I'll ping @ccatalfo about this for when he's back!

Thanks for your patience.

OK, I'll try the extended file - the ones I put up before and the newer books.

Huh! It's importing as we speak - very quick. I don't see the other one but this one is working...and even more interesting, it's the same file, so it's not that something in the file stuck it up. Unless it terminated wrong somehow. WEIRD. Thanks!

>18 jjmcgaffey: Okay, great! Let's just close this for now, since whatever was broken seems to have been temporary... and hope it doesn't crop up again. :)

>14 kristilabrie: I'm trying to reimport my Goodreads library too, but so far nothing has happened: but it's quite big, so I will wait a while to see if it works this time.

It's doing it again - I successfully imported 67 books on the 14th, attempted almost immediately after to import 4 more - and nothing has happened with the four. I gave it a day and tried to reimport, still nothing. Is it stuck in processing again?

Also, if you're busy trying to keep the site safe and functioning, please ignore this until things settle down!

>21 jjmcgaffey: I see your two most recent imports with 4 records stuck at the same stage, asking @ccatalfo about it.

Third time's the charm, I tried again and the latest attempt succeeded in importing 4 books.

Looks like this has come back again. Two attempts, on 11/29 and 12/1, and I just tried for a third time on 12/2. Nothing coming through yet. Same file each time, 49 books without ISBNs.

>24 jjmcgaffey:

Trying the same file each time means that you aren't varying any parameters. How can you tell if it's LT as opposed to the file? What happens if you try a different file, or break the file into two parts and import the two parts separately?

I realize that if there is a bug, it's not your fault. But if you really want to demonstrate the bug, you need to test multiple scenarios.

Scroll up - I've tried multiple ways over the months this has been intermittently showing up. The only thing that has consistently worked (that is, finally got the file to import) is re-submitting a few days apart. So I tried that before reporting the (return of the) bug. I also haven't reported a couple times when resubmitting _did_ work.

>24 jjmcgaffey: Looks like non-ISBN imports got stuck again, even though it looked like they were still processing on our end. (We need to find and fix that.)

@ccatalfo kickstarted your first attempt and it looks like it went through, if you want to have a look?

Got all 49, thanks!

Great, keeping this open for now since we still need to pinpoint the issue, but at least we could finish your import for you!

i'm getting it. I have a rather large 1809 library. Got to 940 and just stuck. No messages, no nothing... Any ideas?

There are lots of things that can go wrong with an import, but you haben't told us much.

How many books?

ISBN look-up or not?

If it's a look-up, what source?

Are you sure all the columns are correct?

>30 simonjbale: Got to 940 and just stuck. No messages, no nothing... Any ideas?

The obvious thing to do is to break the import up into smaller pieces. That many books, the chance of bad data is quite high. If 940 was the problem, start a new import at 941 (or 950, or 1000, or something), and see how it does. Then look at 941 to see if there is something wrong with it, or enter it yourself.

I would think this a good idea anyway, for those doing a lot of imports. We know that the LT import mechanism is a little flaky, but it is also dependent on good data. Don't try to import everything you own all at once! -- not when one error can ruin the whole process. Import 50 or 100 or 200 books at a time and see if it works, then enter the next batch.

>32 waltzmn: I'd also look at the last book that DID import before it stopped - it may be corrupted if that is the line breaking something and it may have managed to import incompletely.

>33 AnnieMod: I'd also look at the last book that DID import before it stopped - it may be corrupted if that is the line breaking something and it may have managed to import incompletely.

Absolutely agree. The point is just, Do the import in small pieces, so you know where the problems are, and then look at the problem parts.

And again - imported 77 books last night, nothing as of tonight. No ISBNs. Is that what's getting stuck?

Same problem here. Was only trying 8 books. All without ISBNs. At this point I should have just manually entered them using copy and paste from my carefully constructed file. Uggggh

I did notice that when it showed me my 8 books, it only showed the first 3 columns. Has the "'PUBLICATION INFO'" column changed its name? I'm just using the sample file but maybe that is out of date.

UPDATE: Whoops. Looks like the second time it may have worked. (I omitted the duplicates in the second file.)
So if you don't use ISBNs, the info about where you are in the queue is always "you don't have anything in the queue?"

Yep, if there's no ISBN there's no ISBN queue. And it looks like it's the no-ISBN imports that get blocked somewhere along the line. I have gotten them to show up twice now by re-importing after a couple days, so that may be what worked (whether you changed the contents of the file or not).

I don't think I've ever had it show me my books - I did a 4-book import a while ago and it got stuck. Where/when did it show you the first three columns?

And stuck again - I sent the file several times over the last week or so and nothing. Any ideas on where it's getting stuck? I recall that for a while someone had to go kick the ISBN queue on a regular basis, is there something similar happening with the non-ISBN queue now?

Sorry for the import trouble! I'll try taking a look this morning and see what I (or @ccatalfo) can do. I'll report back.

>38 jjmcgaffey: Thanks for the wait. Looks to be the same issue (the imports needed a kick)... we'll need to dive further into this when we have time but @ccatalfo is aware of the issue.

Your latest import should be kicked and processing, now! Let me know if there's anything else I can do in the meantime.

Got...one of them, oddly not the latest. But that's fine, it's the same contents. Thanks!

I am having the same issue. Uploaded my first file (with just two books) as a test and 24 hours later I still have no books. I am hoping to upload my nearly 4,000 book collection (none of which has any ISBNs). I am using the csv template provided by LibraryThing.

>42 junebug75: We really need to dig into the non-ISBN imports soon to figure this out, but we're kicking your 2-book upload in the meantime. Please check back on those soon! If you need help kicking the final 4K upload, when you get to it, just let me know. (You can also DM me @kristilabrie, from my profile, or email me at kristiATlibrarythingDOTcom.)

I uploaded to worksheets last week the I got off an old thumb drive. I had to load the drive on a newer Mac in numbers, convert to excel, move excel to my Mac book air, change it to CSV and then it seemed to upload.

I got an email that one worksheet had been received the same day as the upload. But only the names of the books have appeared on my book list.

No word yet on the second larger worksheet ( 900 plus books).

I think I did the columns correctly. I joined an electronics club so I could have some IT get me to this point.

No ISBN numbers..

What next?

>44 vickila49: Thanks for your patience with my response! I took a quick look at your import files and it looks like your headers are not matching LibraryThing's sample .csv file exactly. Please be sure to read over our Help page for how to format your .csv file to match our sample import file exactly (https://wiki.librarything.com/index.php/HelpThing:Import): you must follow the exact same name, order, and spelling of the column headers in the top row—no more and no less—in order to import everything properly. I hope this helps!

>45 kristilabrie: I took a quick look at your import files and it looks like your headers are not matching LibraryThing's sample .csv file exactly

It would be a quick check to make sure the column headers were correct before submitting, and reject the file immediately with an appropriate message. (Or possibly warn, with an option to search the file for ISBNs.)

https://www.librarything.com/topic/290292

Ok. I will try again. I did have a second set of eyes look at this. An retired IT person, but I guess we both missed the miss match. Can you give me a hint? About what’s wrong. I have some dyslexia and am old.

Thank you!!

>47 vickila49: On the Universal Import page, at the bottom of the right sidebar, there's a sample CSV file (LibraryThingSample.csv). That one is definitely correct, so it's the best template to use for yours - that's what I did. Capitalization, single (straight, not curly) quotes, etc. Much easier to get a copy than try to make it from scratch.

I did us the sample. All caps. I could not get the single quotation marks to stick. Do they need to be there. Example: ‘PAGE COUNT’

Yes - but 'PAGE COUNT' - straight quotes, not curly/slanted. It makes a lot of difference to a computer. And the easiest way to do it is to make a copy of the sample and insert your data into it.

The way I do it (I'm importing a list of my ebooks from calibre) - generate a catalog with the proper data in the proper order. Open the spreadsheet that results. Copy the columns (all one chunk, since they're already in the right order). Paste them into another spreadsheet that started as a copy of the LibraryThingSample - I never touch the headers at all, only the cells below them. Save that spreadsheet, upload it to LT.

I deliberately leave the ISBN field blank (delete any ISBNs that appear in the file-to-be-uploaded) because a) a lot of my books don't have them and b) I want my data to match what I have in calibre, not whatever LT digs up for that ISBN. Your choice on that.

It worked! Thank you!
The single quotation mark thing threw me off because when I relabeled the columns the first quotation mark always disappeared. I submitted the spread sheets with the correct heading ,but no quotation marks and for some reason one spread sheet up loaded with just titles. Today,
I retyped all the headings with the straight quotation marks today and even though the first quotation mark doesn’t show on my spread sheet, it must be there because it uploaded.

>51 vickila49: The single quotation mark ' is a special character for Excel when it appears as the first character in a cell. It tells Excel to treat the rest of the string as text and so won't show on your spreadsheet, though it will still be visible in the data entry box for the cell.

It's useful if you want to be able to display in full a data entry that has leading zeros on your spreadsheet. Telephone numbers, zip codes, catalogue codes, etc starting with 0 will show in full if you start the entry with a ' as this forces the number to display as text.

Ah, I'm using Calc - which does have the single quote thing, but apparently doesn't do it if there is another single quote at the end of the cell. Or something. It certainly shows them in my headers (and I've used a single quote to make some 10-digit ISBNs behave, among other things).

I uploaded two spreadsheets in csv with the 11 columns from the universal upload sample spread sheet. I put the single quotations on each column heading. 'TITLE' ETC. I got confirmation that the uploads when through, but on checking the site, I found only the 'TITLE', 'DATE', 'PUBLICATION INFO'. AND 'TAGS' COLUMNS INFO appeared. 'AUTHOR', 'RATING' AND 'REVIEW' 'DATE READ', 'PAGE COUNT' and 'CALL NUMBER' were left blank

I checked load without ISBN.

Why doesn't any of the data in the other columns load?

Weird! I've never had a partial success. I don't upload rating so I don't know what format it wants; Date Read should be the same as Date (yyyy-mm-ddThh:mm:ss(time zone), truncated as you please from the right). But Page Count should be just an integer and Call Number, Review, and certainly Author should be free text. The columns were in the same order as the sample sheet?

No idea. When one of the LT people responds here again, you might offer to give them your spreadsheet so they can look and see where the program is falling down. Or DM kristilabrie and ask if someone can take a look at it.

Thank you for responding.
I would be have to send the spread sheet to anyone who would like to look. I don't see what I am doing wrong unless as you say each column has a special format.

The dates entered with just the year.

"DM" kristilabrie means?

DM = Direct Message, i.e. use the LT message system or send her an email.

Kristilabrie ? Doesn’t seem to be an Email address. How do I find that?
How do I direct message kirstilabrie?

>58 vickila49: She had posted above but here is her profile: https://www.librarything.com/profile/kristilabrie

There is a "Message" button in there in the right menu.

>58 vickila49: You can also click "Contact" at the very bottom of any page to find all the staff email addresses.

I have imported a file (Uploaded csv20240216) with 58 items on Feb. 17th, I waited and checked on Feb. 26th - nothing have been added to my collection. I imported it again, still the same. I thought may be my file is too big (?)

So I separated the first file into two files (Uploaded csv20240216A and Uploaded csv20240216b) and submitted them on Feb. 26th, still nothing happened.

Yesterday, I separated the file (Uploaded csv20240216A) into 2. I tried to test and just submitted the newly separated file (Uploaded csv20240216Aa), still nothing happened this morning.

May I ask what's the problem? My file? or the system? Thanks.

>61 ECCClibrary: May I ask what's the problem? My file? or the system? Thanks.

Someone will probably have a better answer soon, but the first thing to do is to look at your file in extreme detail. It must match the example file exactly.

Yes, I think it was correct because I copy and paste data to each column of the LibrarySample csv file. I have uploaded files many times since October. This kind of problem only happened a couple of times.

I have submitted a file with 10 items on Feb. 24th. It was imported successfully.

Our library is working on database migration. We had submitted files, each with over 100 items before. They were okay.

>63 ECCClibrary: Contact Kristy from the contacts at the bottom of each page. She'll be able to see where and why it's stuck

>61 ECCClibrary: Kristi here! I'll take a look, hold please.

Update: Okay, I think this is more non-ISBN import issues that we still need to dig deep into. They've been having trouble stalling. I'm asking @ccatalfo to check on your original import from February 17 and kick start it if needed.

Okay, your import from Feb 17 should be running @ECCClibrary! I assume your other imports won't end up running, but you may want to keep an eye on your catalog for the next few days in case they come in and you want to delete any duplicate records. I hope this helps.

>66 kristilabrie: Thank you!

Yeah - if the file is right (and if it's been working before, it's right - there haven't been any recent changes) then the problem is the system. I recall when the LT people used to have to kick the ISBN queue on a(n ir)regular basis, and they fixed that, so hopefully they can figure out where the non-ISBN queue is getting choked up.

I have successfully imported 1400+ books (not recently), so really the size of the file doesn't have a lot of effect (takes a bit longer, a few hours instead of minutes...). I regularly import 20-80 books at a time.

>47 vickila49: Hi, I found an easy way was to copy the first (titles/headers) line into a new spread sheet. Then I copied the relevant information from my original excel file into the appropriate columns. final step was to save with the original name_import.csv

FYI - I imported a number of books (56 or so) on March 7th; no reaction, they weren't added, nothing. Today (March 17) I imported 93 books (the original 50+ and some new ones); they were added almost instantly (5 minutes maybe). Identical file format, no ISBNs, identical procedure. Has there been a fix made, or did I just get lucky?

>70 jjmcgaffey: I think the latter, alas (or thankfully?).. no major changes have been made to the import yet, but it is on our list of things to look at, hopefully during our next bug cleanup in the near future. Thanks for your patience; I'm glad the 2nd round worked well for you!

I uploaded about 980 books about 10 days ago. The upload page says I was successful. I see nothing yet in my books. I looked at the Queue box on the upload page. It says I have nothing in the queue. None of my books had ISBN numbers. Do I keep waiting?

>72 vickila49: I see one from April 10, I'll see if @ccatalfo can give it a kick for you. Try checking back in a bit?

Wow. It's all there. A dream come true to get all this catalogued. Great service!
Many thanks!

>74 vickila49: Great! If you run into this again just let us know.

Me again.

I want to show my library to a friend. I looked at the instructions. Went to Safari: typed in http://www.librarything.com/profile/vicila49. My library appeared but it looks like I could alter by accessing it this way.

Is there a way to allow a friend to look but not change?

>76 vickila49: You can change things because it is your library. Other users cannot and see it in read only mode.

Log out or use a different browser or an anononymous window to look at your library to see what other members see.

Thank you. I get it now.

Again, tried an import last night, no reaction some 24 hours later. Could someone give the queue a kick?

>79 jjmcgaffey: I see two more uploads from you the next day with the same number of records. Were those duplicates?

Yeah, I tried again. Twice? I thought it was only once more...I guess I lost track.

It's worked before, to resend the file. And I didn't get duplicates. I don't know if I made more work for you behind the scenes - if so, sorry.

You didn't make any more work! Just wanted to see if those also needed a kick, or if we should ignore them. @ccatalfo should have given your import a kick if you want to check it, now. Thanks for your patience.

Got them, thanks! They had come in by the time I saw your message. Thank you.

Hello! I am trying to import a csv file of about 500 books with no success.
I have read all the above discussions but still could not achieve anything.
The message I keep receiving is: Problem: There are no books in your file.
Could you please help me? Thank you.

>84 idrymaporphyrogenis: Are there ISBNs in the file?

LT has two import options with files: a list of ISBNs (stripping everything else and looking up all isbn looking strings essentially) or the universal import (which should match exactly the example, headers and all).

So my guess is that you do not have ISBNs and your csv file does not match the format. If you post the first 2 lines of your file, we can look at it and provide some help.

>84 idrymaporphyrogenis: It looks like you might be trying to follow our sample .csv import file, but it's not coming through formatted correctly. I would make sure that your file is using utf-8 encoding, and that the columns are all split appropriately without semicolons.

If you're still having trouble after reformatting your file, let me know!

I just heard about this issue, and I guarantee that the file format IS correct, and I have ISBN's for each of 11 books. I tried it several times yesterday ands today with NO books added to my library. Isn't it about time that someone kicked the queue again, or someone else?

I tried importing two batches this morning (both chunks of source code), and not only have I not seen any books show up in my catalog, but the Universal Import page is still showing "You have 0 ISBNs in your lookup queue, including 0 failed and 0 active."

Now, this happened when I did the same thing 2 weeks ago, and I think two days later I realized the books had imported. I wasn't checking often, so I don't know how long it took. But it would be helpful if they'd at least show as in queue, so I wouldn't be tempted to resend (which I have not done).

I'm following exactly the same process that I've done for the past 6+ years, so it shouldn't be anything about what kind of text I'm pasting - which is taken from a carousel of NYT best sellers on a library page.

Well, they were done this morning, so the import took less than 24 hours. But they weren't done when I left work yesterday, so more than 8 hours. Oh, wait - I got the confirmation messages at 12:24am, so ~15 hours

I don't know if this is related to the ISBN-less import issues, but since my original upload file did a) not contain any ISBNs, and b) the import resulted in a wonky lookup queue, I thought I'd mention it here.

My import queue has been looking like this for the last eighteen months:



This is the result of a dodgy upload in February 2023, which did use the LibraryThingSample.csv provided by the website, which did not contain any ISBNs, but which did run into some encoding issues, or perhaps too many colons or commas or something. What the queue thinks is ISBNs is something else entirely. They're not something I put in the original csv, at least not in this format.

Whatever happened, they've been stuck like this ever since. I think that subsequent imports have gone through successfully, but these 51 fake ISBNs never import, and they never go away, either. Clicking "clear queue" does exactly nothing, and hasn't since at least February 2023. I don't know if these fake ISBNs keep cycling through the system.

If this is not related to any issues here, I'll make a separate post.

No, once labeled failed they just sit there. Clearing the queue should get rid of them, yes you should post a bug about that.

Also having some trouble. Uploaded book list in the format of LibraryThingSample.csv. I get "Your import options have been submitted." but going back to the import page shows a completely empty ISBN queue (but my .csv had ISBNs). I tried on both Firefox and Chrome with no luck.

When you uploaded the file, there's a page that says what's going on - how many books it saw, how many ISBNs, if any were duplicates - and it asks you to say where to put the books and any tags. Did you get that page? Did it say you had books in your file? It sounds like a slight mismatch on formatting and LT couldn't find any books in your file - possibly something as simple as no single quotes on the column labels, or one extra or missing column. You might try downloading the sample again, and pasting your data in without touching the column labels. Which browser you use shouldn't have any effect, it's a matter of your file going into LT's computers.

I was uploading a file of 8939 books with no ISBN and it appears to be stuck at 5611. Can someone kick the import queue?

>94 SBMAL1786: It's the weekend, but I'll see if I can get someone to give it a kick. Thanks for the note.

>95 kristilabrie: Thank you! I wasn't expecting a reply until after the long weekend, but it seems to have imported okay now. Thank you so much!!!

>96 SBMAL1786: You're welcome! :)

>97 kristilabrie: hello again. I started another import batch of 2853 books with no ISBN yesterday and it seems to be stuck again as only 21 have been added.

>98 SBMAL1786: Sorry for the trouble! It does appear to be hanging. Let me see if @ccatalfo can give it a kick.

>98 SBMAL1786: The import looks to be running again, albeit very slow. Thanks for your patience!

This fails to import for me

Book Id,Title,Author,Author l-f,Additional Authors,ISBN,ISBN13,My Rating,Average Rating,Publisher,Binding,Number of Pages,Year Published,Original Publication Year,Date Read,Date Added,Bookshelves,Bookshelves with positions,Exclusive Shelf,My Review,Spoiler,Private Notes,Read Count,Owned Copies
20981355,"The Churn (The Expanse, #3.5)",James S.A. Corey,"Corey, James S.A.",,1478929693,9781478929697,2,4.12,Orbit,Kindle Edition,60,2014,2014,2025-1-14,2025/01/14,,,read,,,,1,0

Any idea why?

ISBN: 1478929693 failed

>100 kristilabrie: A few more were added this morning, but nothing new for at least 4 hours.

That's not the standard import spreadsheet - that structure is
'TITLE' 'AUTHOR (last, first)' 'DATE' 'ISBN' 'PUBLICATION INFO' 'TAGS' 'RATING' 'REVIEW' 'DATE READ' 'PAGE COUNT' 'CALL NUMBER'

That's the default import though - are you using GoodReads? (bookshelves looks like GR). I don't use that so I don't know.

I note that one date field has slashes rather than dashes - the importer may not be able to handle that.

>102 SBMAL1786: Blech, let me see if @ccatalfo can poke at it.

>104 kristilabrie: It seems to be chugging along, so hopefully it will finish over the weekend. 🤞 I only have one more import batch after this one.

>105 SBMAL1786: Awesome! Let me know if anything gets stuck again and I can have another look. Thanks for your patience.

>106 kristilabrie: I started my last import batch this morning and it's stuck again.

not sure if I am asking in the correct spot, but I am tryin to upload covers. This all worked find a few month ago. Now not.
I am taking cover picture with my I phone. The label on the picture say:; IMG-4491. HEIc. I follow the steps. I get a message the file type is not supported.

No, this thread is about importing spreadsheets to fill out your library. LT can't handle HEIC images (most places that aren't i-gadgets can't), so you'll have to export it from Photos or whatever app you have as a .jpg/.jpeg and upload that. Apple not playing well with others, as all too frequently happens.

>107 SBMAL1786: I see it, sorry for the trouble! I'll ask @ccatalfo about this one. (Edit: he's going to give it a nudge.)

>110 kristilabrie: It added a few more but now it appears stuck again.

Sorry once again. I'll ask @ccatalfo why this keeps happening and see if he can give it a kick. Thanks for your patience!

>112 kristilabrie: It seems to have stuck again over the weekend.

Oof, sorry! I'm asking @ccatalfo to kick it again.

>114 kristilabrie: I still haven't seen anything added since my last note.

>115 SBMAL1786: Sorry, @ccatalfo is restarting it now and trying to figure out why it keeps dying! Hopefully we can get this to the finish line, this time.

>116 kristilabrie: I got the notification that it completed my upload, but it didn't add any more books. Should I retry the whole batch?

I need to ask @ccatalfo about your import. From my end, it looks like it's still hanging. I wonder if you got a notification for a different import or something. (I'm not sure why this import is giving us so much trouble, either.) Let me see what I can find out tomorrow, I'll try circling back ASAP.

>117 SBMAL1786: Okay, it looks like your import from June 3 completed, which is the notification you got. @ccatalfo restarted the import you submitted on June 10 about an hour ago... let's see how it goes.

>119 kristilabrie: Thanks for the update! It's moving again. 🤞

Looks like it finally finished, and @ccatalfo's fix worked. Thanks so much for your extended patience with that! That was a doozy.

>121 kristilabrie: Hurrah, thank you! 🎉 I see one little weird thing: on our profile it says 16,099 in All Collections, but on the Books tab it says 16,098. I also noticed on our profile under Media it says there is one "Not set" but when I click that it says "No books found" so there is maybe one record caught in limbo somewhere?

>122 SBMAL1786: I've been seeing tiny differences like you've been on other profiles for the last week or two. I'm guessing it's just caching/indexing issues that need time to catch up. I'm going to reindex your catalog in the meantime, so let's see if that fixes it.

>123 kristilabrie: It looks like the reindexing fixed it, thanks! :)

>124 SBMAL1786: Good!

Anybody else having trouble with Universal Import lately? Sometimes mine take pretty quickly and sometimes nothing shows up for hours.

It worked fine for me on 12/5 - 121 books in...20 minutes? Less than half an hour, I'm pretty sure. It's been pretty fast. I have had very slow imports at various times previously - if it doesn't show up in 24 hours I generally post in Bug Reports (new thread), and someone kicks the queue and it clears up (usually).

Is Manual Import a recent general issue? Tring to import a library of about 9000 books. Tried batches of 500 first, but only a small proportion being added, even after 24 hours. Tried a large file of around 7500 - same. Most records won't have ISBNs.

I did a test run about 3 months ago and it was running perfectly,

Are you sure your file is correct? Especially without an ISBN, it will try to put exactly what's in your file - but if the order or headers are wrong...usually it doesn't work at all, rather than being slow, but sometimes it goes through until it chokes up on a row. I downloaded the sample file and use that, copy-pasting from my own file with the new data each time, leaving the headers from the sample file and making sure the columns are in the right places.

As I said in >127 jjmcgaffey:, I had a quick and correct import (of not nearly that many books, but that doesn't usually change much) on December 5.

Yes the files are correct. I've uploaded before without issues, and do pretty much the same as you. ATM, it's imported 10 records in 2 hours; when I tested it in September, batches of eg 500 would take 20 minutes.

>128 ScottishGenSoc: I'm discussing the Universal Import issues I'm seeing with @ccatalfo now. It seems imports are stalling out more frequently over the last week or so.

I'll see if we can give your most recent upload a kick (the 8,144-record upload).

Edited to add: your last import attempt was restarted! Let me know how it goes for you.

Thanks for this. We're still only at 6100, and having checked it this morning it looks like it's still only importing 10 records/2 hours.

>132 ScottishGenSoc: 10 records/2 hours would be 5 records per hour then? But then it would have taken more than 50 days at that rate to get to 6100. Something doesn't add up.

The first batch of 500 was ran on the 8th December, it was fine, as was I think the next couple. by the 11th not only were the batches slower, but it didn't seem to be importing the full 500 records. Which is why I'm repeating the full spreadsheet, but set to skipping duplicates. There's also about 60 rejected ISBNs in total, which I've captured in a separate file now, to add manually.

>132 ScottishGenSoc: >134 ScottishGenSoc: Ah, @ccatalfo is digging and found an error on your import. I'll update soon.

>132 ScottishGenSoc: Update: @ccatalfo un-stuck your import, so it should finish processing at a much better rate now. Let's keep an eye on it - let me know if you notice it hanging again, I'll check back on it tomorrow.

I'm not seeing any improvement. Would killing the process help (if possible)? I'm happy to restart that import from scratch, or the smaller batches, if that might help.

Sorry for the trouble! Let's try kicking it one more time—I think it needed a kick after yesterday's mend—and if it fails again we can kill it so you can try again. Thanks for your patience with this.

Thanks for everybody working on this so promptly. Looks as though the import has worked, although perhaps too well, as it hasn't skipped duplicates! Don't worry about it though, as I'm just going to work through those and delete in Power Edit. About 20% done already.

>139 ScottishGenSoc: Drat! Sorry. I see 1,615 duplicates that were skipped, so maybe it missed some of them (maybe non-ISBN records?). Thanks for your patience with this.

Yes, probably about 75% of our records are non-ISBN, and lots of sequences. No worries though, getting them imported was the main objective. Thanks again for all the support.

Looks as though another import has stalled last night (21/12 about 18:45 GMT). I ran a test of 50 records which was fine. Main import of 500 has only imported about 125. Weirdly they appear if you search LT, eg Annals Of Barrhead, but have not imported into our library, and show 0 members. I know this is our copy as the tags include our unique accession number.

If it is that I can only do very small batches that's fine as long as I know what the limit is, only another 1000 to go.

>142 ScottishGenSoc: The system's just been struggling for the last week or so (as you already know), there shouldn't be a limit but you can certainly use whatever method is easiest for you. I asked @ccatalfo to give the stalled import from the 21st a kick; it should be running now! Thanks again for your patience.

Brill. Thanks very much. Yeah, just unlucky timing, for us. Planning our public launch in January, and some cleanup work here and prepping TinyCat to do yet. Thanks again and Merry Christmas.

Don't hesitate to reach out if we can offer any other support! Merry Christmas and Happy New Year.

Hi! I've tried importing my Goodreads library but it has been stuck for a couple of days. Should I stop, delete and attempt a reupload? Or just keep waiting? Thank you in advance!

>146 coffeeina7: I just kicked it so it should be running again. Apologies for the trouble.

Thank you so much! ☺️

Hello, I opened a new account today and imported books from a .csv file, but my finished count is off. My dashboard shows 543 books uploaded and the status of the upload is complete. However, only 136 books are in my "library." I've looked around but can't see the missing books anywhere. Can you please manually re-index my books and see if that fixes the problem? Otherwise, I'll delete them all and try cleaning up my list and then re-uploading. Thanks for any help you can provide!

>149 SereneReads: I'm having the exact same issue and have tried multiple things. Hoping they fix this soon.

>150 ReubenWoods94: Hi Reuben, my books all showed up this morning, looks like the import process finished overnight, Good luck with yours!

>151 SereneReads: Mine did too! I just did another import (those were my read books, now wanting to import my TBR) so just having to wait again to see if they show up magically after a day lol. Glad yours showed up.

>152 ReubenWoods94: I'm sure they will, like magic, lol! Overall, I'm VERY happy with my upload, considering that my list was somewhat of a mess. I accidentally deleted my Goodreads account a few years ago (never went back) and had to use an ancient export list. I updated that list as much as possible and then did my upload. So now it's just cleaning up, adding some missing covers, and then adding books not on the list. Once I'm finished, I'll make a clean export (and suggest you do the same) and do that every so often "just in case." Cheers!