Author Topic: Temporary Suspension of Graph Generation  (Read 1421 times)

0 Members and 1 Guest are viewing this topic.

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Temporary Suspension of Graph Generation
« on: January 22, 2017, 10:43:58 pm »
Over the next 9-10 days, my algorithms students will be working with TM-derived graph data for a lab assignment.  Since the graphs files change every time I regenerate them even if the underlying data does not (waypoint order, etc), I plan to stop the regeneration of new graphs until this lab is complete so I and my students will have consistent graphs to work with.  Apologies to those who are loading them up and fighting the good fight against NMPs, bad concurrencies, and other issues.  I should be able to restart the generation of new graphs on each site update around February 1 or February 2.

Tonight's site update did include new graphs, so they are currently consistent with what's in GitHub and in the DB.  That will no longer be the case after the next site update.

Offline froggie

  • TM Collaborator
  • Sr. Member
  • *****
  • Posts: 284
  • Last Login:Yesterday at 09:55:34 pm
Re: Temporary Suspension of Graph Generation
« Reply #1 on: January 23, 2017, 07:20:28 am »
Would halting site updates for the next week and a half accomplish the same purpose?  Seems it'd be simpler to just do that...

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Re: Temporary Suspension of Graph Generation
« Reply #2 on: January 23, 2017, 10:06:52 am »
Would halting site updates for the next week and a half accomplish the same purpose?  Seems it'd be simpler to just do that...

No, it's simple enough to perform all except the graph generation.  I add a "-k" flag to one script and it skips those steps.

Offline si404

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 679
  • Last Login:Today at 04:07:00 am
Re: Temporary Suspension of Graph Generation
« Reply #3 on: January 23, 2017, 11:12:15 am »
Would halting site updates for the next week and a half accomplish the same purpose?  Seems it'd be simpler to just do that...

No, it's simple enough to perform all except the graph generation.  I add a "-k" flag to one script and it skips those steps.
With added bonus of not penalising the website bunch much.

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Re: Temporary Suspension of Graph Generation
« Reply #4 on: January 23, 2017, 11:48:53 am »
A better future solution is likely a mechanism where I'd archive "release" versions of the graphs periodically, and have students stick with a particular release version for an assignment or maybe a whole semester.  But that didn't happen in time.

Offline sipes23

  • Newbie
  • *
  • Posts: 27
  • Last Login:July 12, 2018, 03:59:02 pm
Re: Temporary Suspension of Graph Generation
« Reply #5 on: January 24, 2017, 12:37:07 am »
I'm excited that this site has academic applications.

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Re: Temporary Suspension of Graph Generation
« Reply #6 on: January 24, 2017, 07:33:07 am »
I'm excited that this site has academic applications.

It's how I help justify the time I put into the project.  http://courses.teresco.org/metal/

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Re: Temporary Suspension of Graph Generation
« Reply #7 on: January 31, 2017, 10:14:21 pm »
The first lab using our data finished up today, so regular graph generation resumes with tonight's site update (currently in progress).

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Re: Temporary Suspension of Graph Generation
« Reply #8 on: January 17, 2018, 10:47:09 pm »
It's time for my Algorithms students to work with highway graph data from TM again.  In order to keep things consistent for the duration of this first lab assignment that involves the graphs, tonight's site update will be the last to generate new graphs until everyone has finished the relevant tasks.  This could be as soon as a week from tonight but as much as two weeks.  As was the case a year ago, this will not stop site updates from happening, meaning the graphs will become inconsistent with what's the in the database as highway data updates are ingested.

(Edit to fix expected timing of resumption of graph generation.)
« Last Edit: January 17, 2018, 11:12:27 pm by Jim »

Offline dave1693

  • Newbie
  • *
  • Posts: 31
  • Last Login:June 13, 2018, 05:36:59 pm
Re: Temporary Suspension of Graph Generation
« Reply #9 on: January 18, 2018, 02:09:01 am »
I'm excited that this site has academic applications.

As am I. Heck, I'd like to take the class, there's probably new stuff for me to pick up!

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Re: Temporary Suspension of Graph Generation
« Reply #10 on: January 25, 2018, 09:31:41 pm »
Everyone is done with the part of the lab assignment that needed graphs from the site, so I'm regenerating them with tonight's site update.  A new assignment is out tomorrow where they'll be using the graphs again, so this should be the only site update with new graphs for about a week.

Offline yakra

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1349
  • Last Login:Today at 12:37:21 am
Re: Temporary Suspension of Graph Generation
« Reply #11 on: January 25, 2018, 11:47:18 pm »
Does the Temporary Suspension of Graph Generation include tm-master.nmp?

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Re: Temporary Suspension of Graph Generation
« Reply #12 on: January 26, 2018, 06:52:29 am »
Does the Temporary Suspension of Graph Generation include tm-master.nmp?

That gets generated, but might not be uploaded when graphs aren't generated.  I will check and can move it over manually if there's interest.

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Re: Temporary Suspension of Graph Generation
« Reply #13 on: January 26, 2018, 10:39:24 pm »
Graphs were generated tonight, but I don't plan to generate them again until next weekend.

Offline Jim

  • TM Collaborator
  • Hero Member
  • *****
  • Posts: 1155
  • Last Login:Today at 08:35:49 am
Re: Temporary Suspension of Graph Generation
« Reply #14 on: February 03, 2018, 09:54:28 pm »
This weekend, my algorithms students are between assignments that use the METAL graphs generated by TM.  New graphs that include recent highway data changes will be generated tonight.