Author Topic: Failed site update 11-14  (Read 207 times)

0 Members and 1 Guest are viewing this topic.

Online Markkos1992

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2644
  • Last Login:Today at 01:04:44 pm
Failed site update 11-14
« on: November 15, 2022, 06:31:19 am »
Looks like last night's update failed.  It seems to still be going.

Online si404

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1711
  • Last Login:Today at 01:06:37 pm
Re: Failed site update 11-14
« Reply #1 on: November 15, 2022, 06:34:15 am »
I synced my branch up with the master this morning and ran datacheck.sh on it to see if I could find the error. It worked successfully with no errors found.

I don't know what the problem is then.

Online Markkos1992

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2644
  • Last Login:Today at 01:04:44 pm
Re: Failed site update 11-14
« Reply #2 on: November 15, 2022, 08:18:16 am »
Site looks good now.

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2451
  • Last Login:Yesterday at 10:11:24 pm

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2451
  • Last Login:Yesterday at 10:11:24 pm
Re: Failed site update 11-14
« Reply #4 on: November 15, 2022, 10:16:58 am »
Bottom line: I wasn't careful bringing in an email update and didn't notice the extraneous changes to one csv file, then went to bed after starting the site update instead of verifying its completion.  Should be all good now!

Offline yakra

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 3935
  • Last Login:Today at 10:12:30 am
Re: Failed site update 11-14
« Reply #5 on: November 15, 2022, 10:38:08 am »
I synced my branch up with the master this morning and ran datacheck.sh on it to see if I could find the error. It worked successfully with no errors found.

I don't know what the problem is then.
Weird. The fix wasn't committed until after this post.

Looks like last night's update failed.  It seems to still be going.
I assume you saw the red "update in progress" banner atop one of the pages.
This is triggered by the presence of the dbupdating file created during the site update process. If siteupdate.py fails, localupdate.sh exits without deleting the file.

I see few different ways to deal with this:
1. No-build.
2. Create a different file upon failure, which the web pages can detect and produce a new banner, "most recent site update failed" or somesuch.
3. Just quietly delete the dbupdating file upon failure.
4. Remove the dbupdating / banner functionality altogether. Without looking into it, I assume this predates the switch to the two-database (TravelMapping, TravelMappingCopy) model, and isn't really necessary anymore as when an update completes we switch seamlessly from the old to new DB and life goes on for site users.

The downside to #3-4 is it's a more transparent failure mode. Maybe an email notification for failed updates would be a good idea.
Sri Syadasti Syadavaktavya Syadasti Syannasti Syadasti Cavaktavyasca Syadasti Syannasti Syadavatavyasca Syadasti Syannasti Syadavaktavyasca

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2451
  • Last Login:Yesterday at 10:11:24 pm
Re: Failed site update 11-14
« Reply #6 on: November 15, 2022, 08:22:25 pm »
I think an email notification of a failed update would be most helpful.  I would probably have seen an email notification on some device after launching the update but I didn't look back at the terminal where I launched the update or at TM itself until this morning. 

In this particular case, I should have caught the mistake.  I normally do a git diff before the commit and push of HighwayData updates I get by email.  I would have seen unexpected changes in usawi.csv and fixed them.  I should probably also just go ahead and run datacheck at least on my Mac before I commit and push such emailed updates.

Offline Highway63

  • TM Collaborator
  • Sr. Member
  • *****
  • Posts: 467
  • Gender: Female
  • Last Login:November 18, 2022, 11:50:01 pm
Re: Failed site update 11-14
« Reply #7 on: November 18, 2022, 11:42:06 pm »
Bottom line: I wasn't careful bringing in an email update and didn't notice the extraneous changes to one csv file, then went to bed after starting the site update instead of verifying its completion.  Should be all good now!
So, my fault again?

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2451
  • Last Login:Yesterday at 10:11:24 pm
Re: Failed site update 11-14
« Reply #8 on: November 19, 2022, 08:23:03 am »
Both of us, really.  The usawi.csv you sent had two errors in addition to the correct addition of WI 311.  A malformed entry for WI36BusBur and an entry that shouldn't have been there at all anymore for WI42BusMan.  Then I should have done my usual check with a git diff any time I get an email update of a .csv file, which would have quickly brought my attention to these two errors.  Looking back, those changes were previously made to the production version in GitHub when I asked Marrkos1992 to get a large update from you in September into GitHub, and the .csv changes were not communicated back to you.