Author Topic: Temporary Suspension of Graph Generation  (Read 39528 times)

0 Members and 2 Guests are viewing this topic.

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Temporary Suspension of Graph Generation
« on: January 22, 2017, 10:43:58 pm »
Over the next 9-10 days, my algorithms students will be working with TM-derived graph data for a lab assignment.  Since the graphs files change every time I regenerate them even if the underlying data does not (waypoint order, etc), I plan to stop the regeneration of new graphs until this lab is complete so I and my students will have consistent graphs to work with.  Apologies to those who are loading them up and fighting the good fight against NMPs, bad concurrencies, and other issues.  I should be able to restart the generation of new graphs on each site update around February 1 or February 2.

Tonight's site update did include new graphs, so they are currently consistent with what's in GitHub and in the DB.  That will no longer be the case after the next site update.

Offline froggie

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 858
  • Last Login:Yesterday at 06:24:33 pm
Re: Temporary Suspension of Graph Generation
« Reply #1 on: January 23, 2017, 07:20:28 am »
Would halting site updates for the next week and a half accomplish the same purpose?  Seems it'd be simpler to just do that...

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Re: Temporary Suspension of Graph Generation
« Reply #2 on: January 23, 2017, 10:06:52 am »
Would halting site updates for the next week and a half accomplish the same purpose?  Seems it'd be simpler to just do that...

No, it's simple enough to perform all except the graph generation.  I add a "-k" flag to one script and it skips those steps.

Offline si404

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2067
  • Last Login:Today at 12:54:41 am
Re: Temporary Suspension of Graph Generation
« Reply #3 on: January 23, 2017, 11:12:15 am »
Would halting site updates for the next week and a half accomplish the same purpose?  Seems it'd be simpler to just do that...

No, it's simple enough to perform all except the graph generation.  I add a "-k" flag to one script and it skips those steps.
With added bonus of not penalising the website bunch much.

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Re: Temporary Suspension of Graph Generation
« Reply #4 on: January 23, 2017, 11:48:53 am »
A better future solution is likely a mechanism where I'd archive "release" versions of the graphs periodically, and have students stick with a particular release version for an assignment or maybe a whole semester.  But that didn't happen in time.

Offline sipes23

  • Newbie
  • *
  • Posts: 29
  • Last Login:August 19, 2019, 12:44:31 am
Re: Temporary Suspension of Graph Generation
« Reply #5 on: January 24, 2017, 12:37:07 am »
I'm excited that this site has academic applications.

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Re: Temporary Suspension of Graph Generation
« Reply #6 on: January 24, 2017, 07:33:07 am »
I'm excited that this site has academic applications.

It's how I help justify the time I put into the project.  http://courses.teresco.org/metal/

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Re: Temporary Suspension of Graph Generation
« Reply #7 on: January 31, 2017, 10:14:21 pm »
The first lab using our data finished up today, so regular graph generation resumes with tonight's site update (currently in progress).

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Re: Temporary Suspension of Graph Generation
« Reply #8 on: January 17, 2018, 10:47:09 pm »
It's time for my Algorithms students to work with highway graph data from TM again.  In order to keep things consistent for the duration of this first lab assignment that involves the graphs, tonight's site update will be the last to generate new graphs until everyone has finished the relevant tasks.  This could be as soon as a week from tonight but as much as two weeks.  As was the case a year ago, this will not stop site updates from happening, meaning the graphs will become inconsistent with what's the in the database as highway data updates are ingested.

(Edit to fix expected timing of resumption of graph generation.)
« Last Edit: January 17, 2018, 11:12:27 pm by Jim »

Offline dave1693

  • Full Member
  • ***
  • Posts: 187
  • Last Login:July 04, 2024, 05:17:53 am
Re: Temporary Suspension of Graph Generation
« Reply #9 on: January 18, 2018, 02:09:01 am »
I'm excited that this site has academic applications.

As am I. Heck, I'd like to take the class, there's probably new stuff for me to pick up!

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Re: Temporary Suspension of Graph Generation
« Reply #10 on: January 25, 2018, 09:31:41 pm »
Everyone is done with the part of the lab assignment that needed graphs from the site, so I'm regenerating them with tonight's site update.  A new assignment is out tomorrow where they'll be using the graphs again, so this should be the only site update with new graphs for about a week.

Offline yakra

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 4422
  • Last Login:November 11, 2024, 12:50:03 pm
  • I like C++
Re: Temporary Suspension of Graph Generation
« Reply #11 on: January 25, 2018, 11:47:18 pm »
Does the Temporary Suspension of Graph Generation include tm-master.nmp?
Sri Syadasti Syadavaktavya Syadasti Syannasti Syadasti Cavaktavyasca Syadasti Syannasti Syadavatavyasca Syadasti Syannasti Syadavaktavyasca

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Re: Temporary Suspension of Graph Generation
« Reply #12 on: January 26, 2018, 06:52:29 am »
Does the Temporary Suspension of Graph Generation include tm-master.nmp?

That gets generated, but might not be uploaded when graphs aren't generated.  I will check and can move it over manually if there's interest.

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Re: Temporary Suspension of Graph Generation
« Reply #13 on: January 26, 2018, 10:39:24 pm »
Graphs were generated tonight, but I don't plan to generate them again until next weekend.

Online Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 2856
  • Last Login:Today at 07:41:39 am
Re: Temporary Suspension of Graph Generation
« Reply #14 on: February 03, 2018, 09:54:28 pm »
This weekend, my algorithms students are between assignments that use the METAL graphs generated by TM.  New graphs that include recent highway data changes will be generated tonight.