HomeGroupsTalkZeitgeist
  • LibraryThing
  • Book discussions
  • Your LibraryThing
  • Join to start using.

Search updates are down for the weekend

Talk about LibraryThing

Join LibraryThing to post.

1timspalding
Apr 13, 3:23pm Top

This is an FYI that search updates will be down for the weekend. This applies to both "site search" and "catalog search." If you add something, or change something, the data is there. If you look at the book, click to it or whatever, it will be fine. But the search box will not have updated data.

The cause is simple. We are still recovering from the recent downtime, endeavoring to get everything square, redundant and healthy. Much of this is on our systems administrator, Pedro, and he ran out of time to get to this.

Thank you for your patience.

2Sheila_A
Apr 13, 3:35pm Top

It would be helpful to include " will be down for the weekend of April 13-16, 2018" to eliminate confusion.

3kristilabrie
Apr 13, 3:41pm Top

Talk posts are timestamped to the right, but we are indeed talking about this weekend and not next. Thanks!

4jztemple
Apr 13, 8:01pm Top

And thanks for having the web page note this outage in that top box which I'm sure has a technical name, but I haven't coded for the web in about twenty years so I'm sure it would be new to me.

Toughest thing about web coding that long ago was getting the hammer and chisel to stay steady on the screen ;)

5znalo
Apr 13, 8:42pm Top

Don't forget Pedro appreciation day on 27 July.
http://sysadminday.com/

6Sheila_A
Apr 13, 9:57pm Top

jztemple - LOL -- didn't know they allowed chiselers on this site ! And a Shout Out to Sysadmin's everywhere -- Especially on Library Thing -- YOU ROCK ! Even if you did subsist on pizza and caffeine all weekend. . . .

7BookHavenAZ
Apr 14, 11:55am Top

Thank you Pedro!

8benitastrnad
Apr 14, 5:24pm Top

I appreciated the notification and thanks for giving us that. I do most of my LT work on the weekends and it was tough to go through the entire weekend last time with no LT. I think I suffered withdrawal symptoms.

9ladyjanegray
Apr 14, 5:57pm Top

benitastrnad - I hear you. Withdrawal from here is worse than sugar.

10HoldenSchoolLibrary
Apr 14, 6:46pm Top

Is this why I haven't been able to 'check out' items through TinyCat with items I just added this week?

11juglicerr
Edited: Apr 14, 7:33pm Top

Well, I'm glad you told us, but I cannot edit my books or get on any page except the Main Page.
Update: now I can get into other pages, and the tags that disappeared have reappeared.

12zerkalo
Apr 15, 10:22am Top

I can't see since a while todays calendar of births and deaths. Can you fix this?

13paradoxosalpha
Apr 15, 12:01pm Top

"On This Day" was down for me after the downtime, but it came back yesterday and still seems to be working ok.

14zerkalo
Apr 15, 3:12pm Top

I was able to solve this problem. It was quite simple.

Hans

15BWAlibrary
Edited: Apr 15, 3:56pm Top

I was planning to do a lot of adding and editing tomorrow the 16th. There seem to be two dates for the DOWN time. The first says 'the weekend' the other says 13th-16th. If things will not be available for searching other databases and adding to our collection on Monday which is the 16th I don't want to make a 35 mile one way drive to do nothing. Can anyone tell me when the full functionality will be returned? Thank you.

16threadnsong
Apr 15, 3:48pm Top

Thank you so much for your help, Pedro and all related Sysadmins! Being married to a coder for 20+ years is a reality check of how hard these folks work. Bean sprouts and herbal tea once the caffeine and pizza run out.

Like others on this list, I, too, am only able to update LT on weekends. And since I filed an extension for my taxes I'm staring at a pile of books I'm looking forward to updating on my various groups.

17Lyndatrue
Apr 15, 4:09pm Top

>15 BWAlibrary: and >16 threadnsong: You are still able to add books, since that part is unaffected. I've added three myself. I use Overcat almost exclusively, and I've had no trouble adding anything.

18BWAlibrary
Apr 15, 4:10pm Top

I use Library Cat. It SAYS it added one book but when I check in my collection it is not there. Are you finding the books you added actually APPEAR in your collection? Thanks for your help

19MarthaJeanne
Apr 15, 4:16pm Top

>18 BWAlibrary: You seem to be using Amazon as your source. I see http://www.librarything.com/work/16782107/book/154945401 added today. The sources are not affected. Only searching on LT - both site and catalogue searches are not working for new books. You can still sort your catalogue and see the new books that way.

20Lyndatrue
Apr 15, 4:18pm Top

I'm not sure what "Library Cat" is. Yes, the books I added are in my library.

http://www.librarything.com/catalog/Lyndatrue

When I said that I used "Overcat" I meant that it's the one I have selected in Add Books.

https://wiki.librarything.com/index.php/Overcat

I see a very recent addition to your library, here:

http://www.librarything.com/catalog/BWAlibrary

Is the book by Philip Kerr the one you added and cannot see?

21PhaedraB
Apr 15, 7:47pm Top

FWIW, I added one book via the app on Friday which I can't find anywhere. The work page says I don't own it. But the book I added via the app on Thursday is there.

22Vaart
Apr 16, 5:58am Top

It would be fine to know when the weekend ends. The searchfacility seems still to be down on monday 11:57 GMT +1

23MarthaJeanne
Edited: Apr 16, 6:38am Top

Search will be up when it's up. In Maine it is now 6:30 in the morning. They will not be working there yet. When they start working it will take time to get things going. At some point the indexing needs to happen. That takes time, too. We can hope that everything will run smoothly, but it may not.

My hope is that they don't feel pressured to get search of new entries going again quickly, but feel free to take however long it takes to bring it up again safely.

If you want to find books you have recently entered, you can sort your catalogue by entry date. That works.

24kristilabrie
Edited: Apr 16, 8:51am Top

>18 BWAlibrary: If you mean TinyCat, the search index affects both LibraryThing and TinyCat, yes. You can still view and edit your items in your LT catalog (from the "Your books" page), but you won't be able to search for them in LT or TC until we turn the indexes back on. We'll be sure to post here with updates, so please stay tuned here. Sorry for the inconvenience, and thanks for your patience.

25booksforoscar
Apr 16, 12:38pm Top

When do you REALLY expect the SEARCH function to work again? Thank you for your good work!!

26kristilabrie
Apr 16, 1:02pm Top

The developers are hard at work getting us back to normal. I suspect the restoration should be complete and search indexes should be back on sometime this week (hopefully sooner), but please stay posted here for updates. Thanks for your patience.

27gilroy
Apr 16, 2:15pm Top

An interesting question just struck me that I wanted to ask:

With the search indexing not happening at present, does this also stop the auto combining or does that fall into a different process?

28dvdcollection
Apr 16, 4:11pm Top

When this is all over it would be helpful to have a non-technical explanation both for the reasons for the crash as well as the steps that were necessary for the recovery

29tansymews
Apr 16, 4:37pm Top

Is this still current? Or has the weekend elapsed?

30karenb
Apr 16, 4:40pm Top

>29 tansymews:
Still current! Should be fixed this week.

Meanwhile, books are there, they're just not yet indexed (so Search won't find them yet)

31chuck_ralston
Apr 16, 5:46pm Top

Concur with 'dvdcollection', Tim Spaulding / LT Sysadmin, need to brief LT membership about recent upgrade, migration, overhaul. Kudos to Pedro and to the Pedrophiles.

32SabaM
Edited: Apr 16, 7:52pm Top

Hi everyone, I hoping someone can help me. I am looking for the names of three different books.

First : Set in medieval time....were this king (of the like) and he took a unwilling female as a bride, however, she was skilled with herds and healing and she used he knowledge to better the living conditions of his household and lands ....i remember reading about her using herbs to get rid of fleas in their clothes and around the castle and insects from their foods and i think his right hand man did not like her and tried to poison the kings mind against her so much so when he got into battle with an enemy she was injured with a piece of his chain-mail remained in him and he got sicker and he did not allow her to help him cause he thought it was her doing but eventually he did allow her too and with her help he defeated his emery when she showed him how to poison the enemy water. Also there was a moat around the castle.

Second: (this one I barely remember i read this a long long long time ago)
Set in old England a duke (or other) ended up being the caregiver or a ward (young girl) who at first he was indifferent to but as time pass he grow fond of her ... and ended falling in love and marring her (i remember he broke his leg and the cover was red with gold writing)

Third:A wealthy man who own a vineyard and winery married a woman, (cannot remember why they married however they were not lovers) until one night during a thunderstorm they made love and she got pregnant unbeknownst to him until a night during ball he was having she fainted and the doctor revealed she was...he gifted her emeralds as per a family tradition but there is a other female who wanted the man and locked the pregnant woman in abandon cellar ...

I know they are not much to go on, but if someone knows any story slightly familiar please let me know

Thank you

33Taphophile13
Apr 16, 7:59pm Top

>32 SabaM: Welcome to LibraryThing. This is not the group (or thread) you want. The Name that Book group is the place to ask. Be sure to read the Posting Tips, especially about using a helpful subject line, because everyone there is looking for a book.

34Lyndatrue
Apr 16, 8:28pm Top

>28 dvdcollection: and >31 chuck_ralston: and others who may be following along:

There's already been a solid explanation as to what happened, and the steps in repairing (that are still in progress). Here's Tim's specific message where he says what happened:

http://www.librarything.com/topic/289844#6443600

The best details are found in that thread, also.

http://www.librarything.com/topic/289844

35jjwilson61
Edited: Apr 16, 11:31pm Top

>34 Lyndatrue: "I screwed up and messed up some data" Isn't really a solid explanation.

ETA: Not that I believe that Tim owes us an explanation.

36krazy4katz
Apr 16, 11:17pm Top

>35 jjwilson61: Good enough for me. ;-)

37timspalding
Apr 17, 12:03am Top

Pedro was able to install what he needed to get search back up. Tomorrow he'll be finalizing that, so I think the drought will end tomorrow.

38jjmcgaffey
Edited: Apr 17, 2:22am Top

>27 gilroy: Not sure about auto combining - but I had an import go through which did _not_ combine duplicates (it's ebooks, some of which I have as paper books as well). So it may well have affected things. It's probably a good idea to be aware of what you've added during this time, and check it when everything's cleared up (and a little while longer, to allow functions to run).

>37 timspalding: Yay!

39lorax
Apr 17, 9:27am Top

>31 chuck_ralston:

Can you maybe let them finish the actual fix before you start jumping up and down demanding a full accounting? And maybe even spell Tim's name right when you're making entitled demands?

40desales
Apr 17, 9:37am Top

Do you know when it will be back up?

41timspalding
Apr 17, 10:04am Top

We're testing a fix now. If it passes, then the next few hours.

42Eratosthenes
Apr 17, 10:05am Top

Hi there,

Thanks for all the updates! Just to clarify, is is possible that the search indexes went off as early as Wednesday, April 11? I noticed it right away but couldn't figure out what was happening. This would explain it all.

43timspalding
Edited: Apr 17, 10:38am Top

Yes, they were down from when we went down, and remained down when we came up on the 10th. We thought we'd be able to bring them up quickly. Wrong about that…

Sorry. No, that wasn't accurate. It went up and down a bit after we came up.

44timspalding
Apr 17, 10:51am Top

Okay, it's going.

We have 700,000 updates to process. (Wow.) With one consumer that's 8.1 days of work. We are cranking up the consumers--four so far. I'll give updates. It will at least be hours before the most recent changes are applied.

45timspalding
Apr 17, 11:35am Top

11:36 - 661,311

46jztemple
Apr 17, 12:32pm Top

A watched pot and all that ;)

47timspalding
Apr 17, 12:42pm Top

12:42 - 516,114

48MarthaJeanne
Apr 17, 12:51pm Top

You seem to be processing them faster than we are adding new changes.

49AndreasJ
Apr 17, 12:56pm Top

>48 MarthaJeanne:

So you’re saying we’re collectively slacking?

50timspalding
Apr 17, 1:11pm Top

1:10 - 461,133

100k in 30 minutes.

So, another 2.5 hours or so.

51ech1030
Apr 17, 1:17pm Top

vote for pedro

52Daneri
Apr 17, 1:17pm Top

Any idea when the import options will be up and running?

Thanks

53kristilabrie
Apr 17, 1:36pm Top

>52 Daneri: Imports should already be up and running. I'm not seeing any recent import uploads on your account, but you can go ahead and submit an import when you need, from our More > Import/Export options: https://www.librarything.com/more/import.

54rgruberhighschool
Edited: Apr 17, 2:12pm Top

My search is still down. Is there an ETA for when it will be back up? Thank you!

55lorax
Apr 17, 2:16pm Top

>54 rgruberhighschool:

Tim said one hour before your post that it would be up in about two and a half more hours.

56timspalding
Edited: Apr 17, 2:36pm Top

2:34 - 363,877

That shows a slow-down. We did 100k in 1:20, whereas the last time it was 100k in 30m.

So clearly some variability here. Will update as we go.

57hyesearch
Apr 17, 3:08pm Top

Thank you for your efforts and being there for us. It is reassuring to know that our record information is being kept safe while you resolve the issues. LibraryThing deserves kudos!

58timspalding
Apr 17, 3:19pm Top

3:19 - 305,993

59timspalding
Apr 17, 4:00pm Top

4:00 242,659

60BookHavenAZ
Apr 17, 5:16pm Top

Fabulous work, all!!!
All I need to do when I start feeling impatient is remind myself there are over TWO MILLION collections here... that's a lot of data, folks. Breathe.

61timspalding
Apr 17, 5:37pm Top

5:30 27,271

62Petroglyph
Apr 17, 7:00pm Top

Getting there!

63jjwilson61
Apr 17, 7:12pm Top

It should have finished by now.

64timspalding
Apr 17, 9:35pm Top

Yup, it's zero.

This is catalog search. Site search is still behind.

65karenb
Edited: Apr 18, 4:29am Top

\o/ \o/ \o/

Whoo hoo! Thanks, Tim, and Pedro, and everybody else.

66chuck_ralston
Apr 18, 10:35pm Top

Thanks for the references re: TS's explanation.

67chuck_ralston
Apr 18, 11:01pm Top

at 'lorax' -- no jumping up and down, no demanding a full accounting, only an after-action report from LT as to what happened. Thank you for pointing out my mis-spelling of Tim's surname.

68Pitoucat
Apr 19, 3:14pm Top

Am I correct in assuming, from above posts, that all missing books have now been added?
If so, I'd like to report that I am still missing 41 books which I added on August 12 & 13, 2017.

69kristilabrie
Apr 19, 3:30pm Top

The missing books have not yet been restored. Only catalog search index updates were turned back on, and site search index updates should still be running/updating. We'll post here with more updates as we go, thanks for your patience.

70jjwilson61
Apr 19, 4:08pm Top

I believe Tim said that all missing works had been restored. So it should fix those cases where there was a book in your catalog but the title was missing. He's still working on restoring the missing books.

71Pitoucat
Apr 19, 4:49pm Top

Thanks for the clarification.

72timspalding
Apr 20, 10:39am Top

>70 jjwilson61:

At the moment, not all missing works, but only those held both inside AND outside the gap are restored.

73reconditereader
Apr 20, 11:35am Top

Thanks for the running updates, Tim! We appreciate it.

74jjwilson61
Apr 20, 12:09pm Top

>72 timspalding: Well, if there were works created inside the gap but the book or books they were associated with have been deleted then I don't see why the work should need to be restored (unless the book wasn't deleted but also fell into the gap, so to speak).

75timspalding
Apr 20, 1:51pm Top

76al.vick
Apr 20, 1:59pm Top

The search function is still not finding Wrath of the Dragon King by Brandon Mull. A recently added book by al.cover and bluemoon1476. Is the search not completely restored yet? Is is just because the book was added so recently?

77timspalding
Apr 20, 2:00pm Top

Site search? Yes, it has not yet been updated.

78al.vick
Apr 20, 2:02pm Top

ok. I thought since the banner was gone, it had been updated. Is there a estimated time for the site search being updated?

79Collectorator
Apr 20, 4:20pm Top

Is combine works broken?

80Collectorator
Apr 20, 10:10pm Top

>79 Collectorator: Yes, it is.

81timspalding
Edited: Apr 20, 10:35pm Top

>81 timspalding:

No, it isn't.

82Collectorator
Apr 20, 11:09pm Top



83krazy4katz
Edited: Apr 20, 11:30pm Top

Oops. Missed the point. Never mind …. 😊

84r.orrison
Yesterday, 3:39am Top

>82 Collectorator: In general, combining is working fine for me. That problem does occasionally happen with zero-copy works. Sometimes the old magic is still the best.

85Collectorator
Yesterday, 8:38am Top

>84 r.orrison: It's not just zero copy works, though.

86timspalding
Edited: Yesterday, 3:54pm Top

I always love to get bug reports with specifics. Blanket "it doesn't work"s when, yes, it does, go nowhere are are ignored.

Group: Talk about LibraryThing

153,685 messages

This group does not accept members.

About

This topic is not marked as primarily about any work, author or other topic.

Touchstones

No touchstones

About | Contact | Privacy/Terms | Help/FAQs | Blog | Store | APIs | TinyCat | Legacy Libraries | Early Reviewers | Common Knowledge | 124,572,275 books! | Top bar: Always visible