User uploads

[pderocco]

If Travel Mapping had simple passworded accounts, I would think it would be pretty easy to allow a user named xyz to upload a file called xyz.list to a processing directory, from whence the server could automatically process it and make it visible. It would be really nice if we could see the results of our additions within a minute or so. And it would eliminate the need for Jim or anyone to do this manually.

[michih]

https://github.com/TravelMapping/DataProcessing/issues/22

[Jim]

Two thoughts related to this:

- As long as the TM server resides on my research server hosted by my employer, I am strictly limiting who has write access to any part of it.
- We can get much of this functionality with automated merges and pulls from GitHub in what I believe would be a much more secure process.  It wouldn't give results in a minute, since a site update process takes several minutes, mostly to reload the databases.  I am thinking more along the lines of hourly updates.  I am still very hesitant on the automated merges of GH pull requests, so this might be accomplished by having several people with ability to merge PRs, and those changes would go into the next automated update.

[michih]

having several people with ability to merge PRs, and those changes would go into the next automated update.

Sounds great!

[pderocco]

I'm curious: why are everyone's .list files stored in GitHub? I understand why the software is; that's what GitHub is for. But .list files? Why is it necessary to maintain a history of updates? Isn't just storing the latest version of each file all that's necessary? That would eliminate the whole process of pull requests.

[Jim]

I'm curious: why are everyone's .list files stored in GitHub? I understand why the software is; that's what GitHub is for. But .list files? Why is it necessary to maintain a history of updates? Isn't just storing the latest version of each file all that's necessary? That would eliminate the whole process of pull requests.

The history isn't essential, though many users, including me, put in meaningful commit messages about changes to our files.

It was chosen because we were already going to use it for the site update software, the web front end code, and the highway data.  I saw no reason to use a different solution for user data.

I am open to suggestions about other ways to store them that would work better.

[dave1693]

I personally was using CVS to maintain a history of my .list file dating back to whenever it was I started with CHM. So I myself am quite thankful for the choice to use GitHub for storing .list fines on TM. YMMV.

[yakra]

^ One thing I love about git is the ability to go back thru the history & blame and see when and in what context a given line was added or edited.

It's great for source code, though I bet most people will not make heavy use of it for .list files. Still, it's a tool at our disposal for answering "What else was I doing on that road trip; how did I get there?" type questions.