### Author Topic: Project Statistics  (Read 23027 times)

0 Members and 1 Guest are viewing this topic.

#### yakra

• TM Collaborator
• Hero Member
• Posts: 1909
• Last Login:Today at 01:09:05 am
##### Re: Project Statistics
« Reply #105 on: November 07, 2018, 05:09:43 pm »
That's what I get for just doing a quick Wiki walk -- Maughan Library -> Strand Campus -> OK, that's where it is? Sure!
"LB" means London Borough, I take it?

A little more digging (No further programming yet, just some spreadsheetery) reveals:
This node is 13 steps away from the master node that represents the whole world.
It is the only node of this size.
How many points/unique locations it or its four children contain is still an open question.

How about nodes 12 steps away from the master node?
There are 20 of those, with the majority in the UK. Three are in Puerto Rico. One at the Cincinnati OH / Covington KY line. Seems natural, with dense road networks in these places. And there's one in... Portland, meaning I was probably a bit too generous with waypoints when designing US1Alt, ME77 & pals back in the day.

The least dense node with 1 or more waypoints?
« Last Edit: November 07, 2018, 05:24:15 pm by yakra »

#### si404

• TM Collaborator
• Hero Member
• Posts: 871
• Last Login:Today at 07:29:23 am
##### Re: Project Statistics
« Reply #106 on: November 07, 2018, 07:15:54 pm »
"LB" means London Borough, I take it?
Yep.
Quote
How many points/unique locations it or its four children contain is still an open question.
For it: 51 points (non hidden, all but 7 junctions between two routes). 69 edges between them (one a concurrency) and 26 between them and points not inside the box (two a concurrency).

I copyied (roughly in terms of actual locations) the HDX across onto a screengrab of the wpteditor with the box on

#### yakra

• TM Collaborator
• Hero Member
• Posts: 1909
• Last Login:Today at 01:09:05 am
##### Re: Project Statistics
« Reply #107 on: November 07, 2018, 07:18:27 pm »
Looks like we had almost the same idea.
« Last Edit: November 07, 2018, 07:31:58 pm by yakra »

#### yakra

• TM Collaborator
• Hero Member
• Posts: 1909
• Last Login:Today at 01:09:05 am
##### Re: Project Statistics
« Reply #108 on: November 07, 2018, 08:03:34 pm »
Here are the other 13th-level nodes, with a quick-n-dirty name I picked for each.

Zoom in a bit, search for the code in the vertex/edge list, and click.
Center your mouse, Alt+Tab away, move mouse away from canvas, Alt+Tab back*, and click the OSM or Google links.

*Yes, I plan to eventually improve that...

OKAY I AM GOING TO CLOSE DOWN MY WEB BROWSER AND STEP AWAY FROM THE COMPUTER NOW

#### yakra

• TM Collaborator
• Hero Member
• Posts: 1909
• Last Login:Today at 01:09:05 am
##### Re: Project Statistics
« Reply #109 on: November 08, 2018, 01:56:17 am »
https://github.com/TravelMapping/DataProcessing/pull/126/files
The WaypointQuadtree has been initialized all these years with the latitude and longitude bounds swapped. It hasn't broken anything, but just led to a sub-optimal distribution of child nodes.
After fixing it, we're down from 42757 to 35165 total nodes with the latest HighwayData.
Compare these side-by-side in two browser tabs:

With the bug, The nodes along the western edge of the map have their eastern boundaries, and centers, asymptotically approaching -90°, rather than the normal -180°.
The de facto W bound of each node is -90°, but points W of there can still be inserted normally, because they're W of the parent node's center -- be it 0°, -45°, -67.5°, -78.75°, etc.
As more points are added and these nodes are refined, they effectively become narrower and narrower "stripes" stretching all the way west.

The mirror image applies along the eastern edge, of course.

A couple of our final unrefined nodes:
Code: [Select]
`NE_A http://www.openstreetmap.org/?lat=35.191956&lon=-89.998627SE http://www.openstreetmap.org/?lat=35.189209&lon=-89.998627SW http://www.openstreetmap.org/?lat=35.189209&lon=-90.000000NW http://www.openstreetmap.org/?lat=35.191956&lon=-90.000000NE_B http://www.openstreetmap.org/?lat=35.191956&lon=-89.998627...SE_A http://www.openstreetmap.org/?lat=35.131531&lon=-89.998627SW http://www.openstreetmap.org/?lat=35.131531&lon=-90.000000NW http://www.openstreetmap.org/?lat=35.134277&lon=-90.000000NE http://www.openstreetmap.org/?lat=35.134277&lon=-89.998627SE_B http://www.openstreetmap.org/?lat=35.131531&lon=-89.998627`A bit smaller than central London, innit!

With latitude, things are less interesting: there are just four extra nodes each N of the N pole & S of the S pole, that never receive any waypoints.
« Last Edit: November 08, 2018, 11:20:55 am by yakra »

#### yakra

• TM Collaborator
• Hero Member
• Posts: 1909
• Last Login:Today at 01:09:05 am
##### Re: Project Statistics
« Reply #110 on: December 13, 2018, 11:27:01 am »
I realized my list file now has 3784 lines, which got me wondering how many people have files that long.  Mine is 16th longest.   One user (vespertine) has over 8000 lines, two more are over 7000, two more over 6000, and 2 more over 5000.  94 of our 224 users have at least 1000 lines in their list files.
How many lines in the average .list file?
How many HighwaySegments does the average traveler have .listed?
I'm more interested in the number explicitly .listed, before concurrency augmentation takes place.

#### Jim

• TM Collaborator
• Hero Member
• Posts: 1397
• Last Login:Today at 07:30:19 am
##### Re: Project Statistics
« Reply #111 on: December 13, 2018, 02:56:00 pm »
Here are the current numbers of lines per .list file.  Note that some will be invalid lines, comments, or blank lines, so consider them a bit on the high side in many cases.  The average number of lines per file is 1235.8.

Code: [Select]
`    8437 vespertine.list    7930 mapcat.list    7234 oscar.list    7074 bejacob.list    6364 froggie.list    5877 chaddean.list    5768 dharwood.list    4937 okroads.list    4463 charliezeb.list    4332 mapmikey.list    4213 ntallyn.list    4144 justjake.list    3972 lkefct.list    3933 dcm55343.list    3833 terescoj.list    3833 michih.list    3776 bhemphill.list    3758 mefailenglish.list    3492 duke87.list    2963 htm_duke.list    2919 terminal_moraine.list    2782 valedc03ls.list    2759 aaroads.list    2743 skatcher.list    2721 klundgren.list    2719 johninkingwood.list    2669 wadsteckel.list    2665 ua747sp.list    2460 dave1693.list    2380 jeffm.list    2347 jonfmorse.list    2281 panda80.list    2243 mikeandkristie.list    2165 cinx.list    2147 rlee.list    2142 roadgeek_adam.list    2110 cl94.list    1925 barefoot_driver.list    1922 sbeaver44.list    1922 afarina.list    1880 master_son.list    1870 pnrrth.list    1865 dfilpus.list    1847 drebbin37.list    1809 philimon.list    1791 deathtopumpkins.list    1714 bogdymol.list    1709 lowenbrau.list    1706 regoarrarr.list    1688 squatchis.list    1680 jerseyman4.list    1668 julmac.list    1625 hoopitypoop.list    1623 ngrier.list    1618 tikester.list    1578 pahighways.list    1570 sipes23.list    1563 wphiii.list    1550 mirage45331.list    1548 nrm1221.list    1497 hoss6884.list    1495 imgoph.list    1490 capn.list    1470 quidditch33.list    1466 gpw.list    1456 niels.list    1441 synkdorbit.list    1438 dantheman.list    1425 kramer.list    1384 kjslaughter.list    1383 vdeane.list    1365 griffith.list    1365 cabiness42.list    1361 tckma.list    1348 sneezy.list    1336 dcharlie.list    1316 1995hoo.list    1284 norheim.list    1284 new_friends_gr.list    1270 codyg1985.list    1259 osu_lsu.list    1245 morriswa.list    1236 bobcobb.list    1232 si404.list    1206 scott_stieglitz.list    1182 mojavenc.list    1144 keithcavey.list    1118 jackgaynor.list    1105 markkos1992.list    1103 extremebandman.list    1100 mc49399.list    1086 ChrisZwolle.list    1068 verruckte_dan.list    1061 eucitizen.list    1044 the_spui_ninja.list    1033 njroadhorse.list    1027 bickendan.list    1024 gman2337.list     960 angelsfreeek.list     957 mwasleski.list     955 yakra.list     953 presidentman.list     950 jwood.list     921 jimvette.list     915 tbwillie.list     913 tag42481.list     904 roadguy2.list     898 jbum86MASTER.list     889 ssgtcrusty.list     888 crosboro7.list     869 intheam.list     864 spinoza.list     844 Ugnaught2.list     844 25or6to4.list     841 JamesMD.list     835 thefxexpert.list     829 7_8.list     828 jstalica.list     826 clong.list     817 dough4872.list     815 baugh17.list     794 thing342.list     766 radison.list     764 cougar1989.list     763 navigator.list     729 eth.list     694 pianocello130.list     691 osu97gp.list     688 mvak36.list     681 clark1mt.list     654 neilbert.list     652 iowahighways.list     651 snowedin.list     641 dgolub.list     637 mariethefoxy.list     625 tomhart.list     615 highplainstrvlr.list     613 epzik8.list     597 w9tam.list     593 roukan.list     592 jpinyan.list     591 Beerman.list     574 hurricanehink.list     572 Chikara.list     566 twinsfan87.list     564 eidderf.list     541 DJCane.list     492 lakewy17.list     487 foresthills93.list     483 drfrankenstein.list     480 paulthemapguy.list     480 opspe.list     479 rschen7754.list     476 yipcoyote.list     476 rickmastfan67.list     475 dnthrox.list     475 bulldog1979.list     458 route56.list     455 neroute2.list     448 lamsalfl.list     436 jweeks.list     431 snowmatt8.list     429 based8.list     424 ohroadscholar.list     419 myselfalso.list     408 tarheel61581.list     404 inagaddadavida.list     403 mr_matt_k.list     392 rebelgtp.list     386 jjbers.list     382 cyhighways.list     375 thehighwayman3561.list     374 dscarroll.list     370 jayhawkco.list     330 bubaclex.list     328 verumsolum.list     303 dsm4cy.list     303 compdude787.list     292 voyager105.list     290 ibexto.list     287 dylucktrocket.list     275 Aseluit.list     263 dsaneus.list     261 moshitea.list     237 roadgeek99.list     237 along.list     207 georgiaroadgeek.list     206 bm7.list     205 atsiatas.list     203 ran4sh.list     192 intelati49.list     191 slorydn1.list     191 1.list     190 xorodejon.list     168 happy5214.list     166 electronym.list     162 tjj25.list     161 peperodriguez2710.list     150 paddy.list     149 sounderbruce.list     130 gimmicks.list     128 xcvxcvxcv.list     125 golubcar.list     118 boris.list     117 scheidler.list     115 riiga.list     113 harvey.list     110 sammi.list     108 es92.list     103 skoutr1.list      98 sercamaro.list      88 finnedude.list      75 jordancarrpeterson.list      75 dctransit.list      73 mepaulrye.list      72 noelbotevera.list      71 vinoman64.list      70 kurzov.list      66 whopperman.list      66 sfisher.list      66 philman.list      62 vcap36.list      60 polabare.list      53 dognm16.list      50 usaidhello.list      45 Qiviuq.list      35 robringstad.list      26 rgentry.list      26 ThelwallViaduct.list      21 superblu2007.list       8 riehlj.list       8 YaxStarTest.list       1 benjamingrove47.list`

#### yakra

• TM Collaborator
• Hero Member
• Posts: 1909
• Last Login:Today at 01:09:05 am
##### Re: Project Statistics
« Reply #112 on: December 13, 2018, 06:20:23 pm »
How many HighwaySegments does the average traveler have .listed?
I'm more interested in the number explicitly .listed, before concurrency augmentation takes place.
I'm working from a somewhat outdated version of the HighwayData repo here locally, but here's what I get:
4281202 traveler-segments. (More recent additions, such as usaal -> preview, are certain to increase this.)
Divided by 231 .list files, that's 18533.3 segments per .list.

Most-clinched segment is VA I-95 84 86, with 128 travelers.
Edit: There may be other segments tied at 128 travelers. I didn't check for more; this was simply the first one found.
« Last Edit: December 13, 2018, 08:22:25 pm by yakra »

#### froggie

• TM Collaborator
• Sr. Member
• Posts: 427
• Last Login:April 18, 2019, 11:27:47 am
##### Re: Project Statistics
« Reply #113 on: December 13, 2018, 09:21:52 pm »
^^ According to my log, I have 6,100 "good lines".

#### Jim

• TM Collaborator
• Hero Member
• Posts: 1397
• Last Login:Today at 07:30:19 am
##### Re: Project Statistics
« Reply #114 on: December 14, 2018, 08:31:03 am »
I was playing around with a little SQL this morning (isn't everyone?) and built a query that gives the number of TM "segments" clinched by user:

Code: [Select]
`select traveler, count(*) as segments from clinched group by traveler order by segments desc;`
Code: [Select]
`+--------------------+----------+| traveler           | segments |+--------------------+----------+| oscar              |   153495 || mapcat             |   150511 || vespertine         |   117445 || charliezeb         |   105478 || dharwood           |    83569 || froggie            |    80287 || bejacob            |    80211 || duke87             |    68985 || mefailenglish      |    68303 || mapmikey           |    65753 || valedc03ls         |    65667 || lkefct             |    64822 || okroads            |    64619 || michih             |    63874 || justjake           |    62768 || barefoot_driver    |    60315 || terminal_moraine   |    59856 || terescoj           |    59777 || aaroads            |    57313 || jonfmorse          |    54048 || bhemphill          |    48231 || pnrrth             |    47555 || ntallyn            |    45193 || dcm55343           |    45188 || chaddean           |    44314 || jeffm              |    42817 || panda80            |    42233 || wadsteckel         |    41384 || ua747sp            |    41200 || master_son         |    40915 || julmac             |    40457 || cl94               |    37368 || hoopitypoop        |    37201 || tikester           |    36098 || dfilpus            |    35514 || johninkingwood     |    35350 || intheam            |    34161 || ngrier             |    33431 || bobcobb            |    33124 || drebbin37          |    33049 || jimvette           |    32706 || sipes23            |    32464 || skatcher           |    32378 || htm_duke           |    32057 || klundgren          |    32000 || roadgeek_adam      |    31969 || norheim            |    30813 || rlee               |    29691 || angelsfreeek       |    29611 || cinx               |    29571 || deathtopumpkins    |    29381 || gman2337           |    29222 || highplainstrvlr    |    28904 || ChrisZwolle        |    28153 || ssgtcrusty         |    27452 || mikeandkristie     |    27109 || capn               |    26825 || dcharlie           |    26637 || kramer             |    26441 || codyg1985          |    26297 || new_friends_gr     |    26171 || sneezy             |    25486 || mirage45331        |    25463 || dave1693           |    24465 || quidditch33        |    23891 || eucitizen          |    23808 || bogdymol           |    23496 || jerseyman4         |    23402 || lowenbrau          |    23112 || sbeaver44          |    22892 || wphiii             |    22849 || osu_lsu            |    22535 || tckma              |    22370 || pahighways         |    22301 || regoarrarr         |    22107 || afarina            |    21978 || jstalica           |    21580 || niels              |    21087 || whopperman         |    20714 || mojavenc           |    20684 || hoss6884           |    20624 || cabiness42         |    20566 || 1995hoo            |    20450 || bickendan          |    20267 || squatchis          |    20163 || the_spui_ninja     |    19359 || synkdorbit         |    19024 || jackgaynor         |    18851 || philimon           |    18825 || dnthrox            |    18796 || Ugnaught2          |    18780 || scott_stieglitz    |    18728 || jweeks             |    18538 || w9tam              |    18352 || vdeane             |    18334 || keithcavey         |    18238 || imgoph             |    18048 || thehighwayman3561  |    17984 || nrm1221            |    17806 || crosboro7          |    17512 || jayhawkco          |    17441 || 25or6to4           |    17365 || griffith           |    17331 || tag42481           |    17298 || gpw                |    17003 || dantheman          |    16915 || snowedin           |    16911 || lamsalfl           |    16895 || spinoza            |    16604 || morriswa           |    16218 || hurricanehink      |    15985 || njroadhorse        |    15945 || thing342           |    15487 || kjslaughter        |    15443 || mc49399            |    15422 || presidentman       |    15272 || mvak36             |    15063 || DJCane             |    14968 || verruckte_dan      |    14937 || twinsfan87         |    14804 || mwasleski          |    14633 || Based8             |    14450 || yipcoyote          |    14310 || jwood              |    14293 || rebelgtp           |    14152 || paulthemapguy      |    14068 || JamesMD            |    13722 || 7_8                |    13456 || clong              |    13335 || inagaddadavida     |    13310 || clark1mt           |    13252 || yakra              |    13214 || opspe              |    12994 || thefxexpert        |    12851 || foresthills93      |    12803 || tbwillie           |    12668 || radison            |    12665 || navigator          |    12636 || cougar1989         |    12374 || osu97gp            |    12364 || markkos1992        |    12348 || extremebandman     |    12250 || jbum86MASTER       |    11733 || pianocello130      |    11591 || epzik8             |    11523 || eth                |    11453 || neilbert           |    10979 || rschen7754         |    10796 || iowahighways       |    10784 || baugh17            |    10781 || Beerman            |    10107 || Chikara            |    10057 || eidderf            |     9856 || si404              |     9558 || ibexto             |     9533 || roadguy2           |     9455 || lakewy17           |     9032 || tomhart            |     8973 || slorydn1           |     8808 || route56            |     8756 || jpinyan            |     8410 || mariethefoxy       |     8381 || drfrankenstein     |     8259 || roukan             |     8162 || along              |     8128 || dough4872          |     8069 || bulldog1979        |     7573 || intelati49         |     7159 || snowmatt8          |     6930 || myselfalso         |     6878 || dgolub             |     6850 || moshitea           |     6811 || cyhighways         |     6802 || atsiatas           |     6642 || paddy              |     6522 || Aseluit            |     6345 || bubaclex           |     6201 || electronym         |     6117 || ran4sh             |     6082 || happy5214          |     5801 || dsaneus            |     5643 || rickmastfan67      |     5545 || dsm4cy             |     5445 || tarheel61581       |     5441 || dscarroll          |     5323 || neroute2           |     5117 || voyager105         |     5043 || ohroadscholar      |     4866 || compdude787        |     4860 || tjj25              |     4366 || verumsolum         |     4301 || gimmicks           |     4240 || dylucktrocket      |     4199 || jjbers             |     4162 || mr_matt_k          |     4152 || roadgeek99         |     4090 || georgiaroadgeek    |     3605 || bm7                |     3583 || skoutr1            |     3303 || peperodriguez2710  |     3267 || sammi              |     2897 || xcvxcvxcv          |     2810 || es92               |     2605 || riiga              |     2539 || sfisher            |     2503 || sounderbruce       |     2386 || harvey             |     2222 || dctransit          |     2142 || boris              |     2091 || rgentry            |     2047 || xorodejon          |     1898 || vinoman64          |     1878 || 1                  |     1712 || vcap36             |     1712 || golubcar           |     1639 || kurzov             |     1395 || scheidler          |     1210 || sercamaro          |     1197 || finnedude          |     1190 || mepaulrye          |     1109 || robringstad        |     1070 || riehlj             |      912 || polabare           |      902 || philman            |      811 || dognm16            |      804 || noelbotevera       |      779 || ThelwallViaduct    |      605 || jordancarrpeterson |      566 || superblu2007       |      489 || usaidhello         |      152 |+--------------------+----------+`

#### Jim

• TM Collaborator
• Hero Member
• Posts: 1397
• Last Login:Today at 07:30:19 am
##### Re: Project Statistics
« Reply #115 on: December 14, 2018, 08:39:14 am »
Here's another.

Code: [Select]
`select segmentid, count(*) as travelcount from clinched group by segmentid order by travelcount;`
This gives all segments ordered by number of travelers.  It's 440,000+ lines long, but we can see that 13 segments are traveled by 129 travelers each, which is the most of any.  I'd have to expand the query to join with the segments and probably routes tables to get meaningful information about those segments like the end waypoints and the name of the route.

#### froggie

• TM Collaborator
• Sr. Member
• Posts: 427
• Last Login:April 18, 2019, 11:27:47 am
##### Re: Project Statistics
« Reply #116 on: December 14, 2018, 09:39:49 am »
^ Is there a fairly easy way to determine how many route segments have been traveled by only one user, aggregated by region and/or system, compared to the total number of segments?

#### Jim

• TM Collaborator
• Hero Member
• Posts: 1397
• Last Login:Today at 07:30:19 am
##### Re: Project Statistics
« Reply #117 on: December 14, 2018, 10:07:35 am »
^ Is there a fairly easy way to determine how many route segments have been traveled by only one user, aggregated by region and/or system, compared to the total number of segments?

That's among the things I'd like to add.  Somewhere in the forum or in a GitHub issue, this was referred to by someone as a "TM Pioneer" - the only traveler to clinch a segment/route/connected route.  I think I just need to take a day to experiment with some interesting SQL queries and get them into appropriate existing or new places in the web front end.  I envision maps where segments are colored by number of travelers, possibly with some special highlighting of segments traveled by a single user.

#### oscar

• TM Collaborator
• TM Collaborator
• Hero Member
• Posts: 718
• Last Login:Today at 05:16:38 am
##### Re: Project Statistics
« Reply #118 on: December 14, 2018, 11:31:02 am »
I envision maps where segments are colored by number of travelers, possibly with some special highlighting of segments traveled by a single user.

Based on my own travels, you'll have quite a few route segments traveled by a single user, especially in preview systems like cansk. Might not be "special" enough to warrant highlighting.

#### yakra

• TM Collaborator
• Hero Member
• Posts: 1909
• Last Login:Today at 01:09:05 am
##### Re: Project Statistics
« Reply #119 on: December 14, 2018, 01:21:13 pm »
^ Is there a fairly easy way to determine how many route segments have been traveled by only one user, aggregated by region and/or system, compared to the total number of segments?
aggregated by system:
http://yakra.teresco.org/tmtools_demos/pioneers/outdated_UserData/pioneers.log
Edit: Ignore this for now. List Names are showing up incorrectly. E.G., tikester's trailblazing segments of either CA US101BusPas or CA US101HisPas are showing up as CA US101 proper.
Fixed.

Edit: I should note that this is also only for segments explicitly .listed by a traveler, without any augments for concurrencies.
« Last Edit: December 15, 2018, 01:56:09 pm by yakra »