Travel Mapping

Highway Data Discussion => In-progress Highway Systems & Work => Topic started by: yakra on February 02, 2016, 03:30:24 am

Title: yakra's collaborator thread
Post by: yakra on February 02, 2016, 03:30:24 am
What I'm working on...
This list isn't necessarily up to date.

Regions I maintain:
USA:
• AR datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=AR) NMPs (http://travelmapping.net/logs/nmpbyregion/ar.nmp) outlook (http://forum.travelmapping.net/index.php?topic=4051.new#new)
• CT datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=CT) NMPs (http://travelmapping.net/logs/nmpbyregion/ct.nmp) outlook (https://forum.travelmapping.net/index.php?topic=4742.new#new)
• KS datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=KS) NMPs (http://travelmapping.net/logs/nmpbyregion/ks.nmp) outlook (https://forum.travelmapping.net/index.php?topic=4634.new#new)
• MA datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=MA) NMPs (http://travelmapping.net/logs/nmpbyregion/ma.nmp) outlook (https://forum.travelmapping.net/index.php?topic=4322.new#new)
• ME datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=ME) NMPs (http://travelmapping.net/logs/nmpbyregion/me.nmp) outlook (http://forum.travelmapping.net/index.php?topic=1788.new#new)
• NE datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=NE) NMPs (http://travelmapping.net/logs/nmpbyregion/ne.nmp) outlook (http://forum.travelmapping.net/index.php?topic=2086.new#new)
• NH datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=NH) NMPs (http://travelmapping.net/logs/nmpbyregion/nh.nmp) outlook (https://forum.travelmapping.net/index.php?topic=4651.new#new)
• NJ datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=NJ) NMPs (http://travelmapping.net/logs/nmpbyregion/nj.nmp) outlook (https://forum.travelmapping.net/index.php?topic=4009.new#new)
• NY datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=NY) NMPs (http://travelmapping.net/logs/nmpbyregion/ny.nmp) outlook (http://forum.travelmapping.net/index.php?topic=2085.new#new)
• OK datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=OK) NMPs (http://travelmapping.net/logs/nmpbyregion/ok.nmp) outlook (http://forum.travelmapping.net/index.php?topic=2307.new#new)
• RI datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=RI) NMPs (http://travelmapping.net/logs/nmpbyregion/ri.nmp) outlook (https://forum.travelmapping.net/index.php?topic=3833.new#new)
• TX datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=TX) NMPs (http://travelmapping.net/logs/nmpbyregion/tx.nmp) outlook (http://forum.travelmapping.net/index.php?topic=1808.new#new)
CAN:
• AB datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=AB) NMPs (http://travelmapping.net/logs/nmpbyregion/ab.nmp) outlook (http://forum.travelmapping.net/index.php?topic=2222.new#new)
• MB datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=MB) NMPs (http://travelmapping.net/logs/nmpbyregion/mb.nmp) outlook (https://forum.travelmapping.net/index.php?topic=4812.new#new)
• NB datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=NB) NMPs (http://travelmapping.net/logs/nmpbyregion/nb.nmp)
• NS datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=NS) NMPs (http://travelmapping.net/logs/nmpbyregion/ns.nmp) outlook (http://forum.travelmapping.net/index.php?topic=2337.new#new)
• PE datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=PE) NMPs (http://travelmapping.net/logs/nmpbyregion/pe.nmp) outlook (http://forum.travelmapping.net/index.php?topic=2594.new#new)
• NL datacheck (http://travelmapping.net/devel/datacheck.php?sys=null&showmarked=on&rg=NL) NMPs (http://travelmapping.net/logs/nmpbyregion/nl.nmp)

Systems in Preview:
canabs: Alberta Provincial Highways 500-986 (http://tm.teresco.org/forum/index.php?topic=2169)
canmbp: Manitoba Provincial Roads (http://tm.teresco.org/forum/index.php?topic=2344)
usanyp: New York Parkways (http://tm.teresco.org/forum/index.php?topic=1928)

Systems in Development:
cannss: Nova Scotia Scenic Travelways (http://tm.teresco.org/forum/index.php?topic=63)

Complete but commented out while I deal with my peer review backlog:
Texas Farm-to-Market Roads
Texas Ranch-to-Market Roads
Title: Re: yakra's collaborator thread
Post by: yakra on February 02, 2016, 03:32:01 am
ToDo / Outlook / Notepad

ME:
US1AltPor: trimmed overdense points
ME77: trimmed overdense points
fieldcheck 92 S End

PE: "Second-wave" newsworthy updates, after transition to TM, vs ROADJURIS
TX: US84/FM399 jct: add "TO" to labels?

yakra.list:
USANY
NY NY22 southernmost point? Croton Falls?
NY22+/50+ (incl 343)
NY35?
NJ US1&9; NY US9
CO

harvey.list:
MA: inside 128; return trip: 290, 495?
PA: gaps in Harrisburg, Emerald
NC: route to SC?
GA: intown or byp @ Madison?
FL: Miami <-> Homestead

Mexico:
Mexico Federal Autopistas (http://clinched.s2.bizhat.com/viewtopic.php?t=799)
Mexican Federal Highways (http://clinched.s2.bizhat.com/viewtopic.php?t=812)
Mexican State Expressways (Autopistas) (http://clinched.s2.bizhat.com/viewtopic.php?t=827)
Title: yakra's Open threads & posts
Post by: yakra on February 02, 2016, 03:32:33 am
Open threads & posts

Merged; waiting on site update:
(none)

Pull Request in progress:
(none)

Committed:
(none)

To be submitted:
(none)

Needs action:
OK: annoying US60 & US70 relocations (https://forum.travelmapping.net/index.php?topic=4014)
OK: letter-suffixed spurs (https://forum.travelmapping.net/index.php?topic=4810)
NY: NY 17 by Hillburn and its concurrencies with I-87 and I-287 (http://tm.teresco.org/forum/index.php?topic=456)
NY: NY878Far Northern Endpoint (https://forum.travelmapping.net/index.php?topic=4629)
NY: NY 9A Southern Endpoint (https://forum.travelmapping.net/index.php?topic=4630)
NY: I-495 Exit Numbers (https://forum.travelmapping.net/index.php?topic=4632)
NY: NY24Riv, NY 25, NY 27, NY 347, and NY 454 Minor Point Concerns (https://forum.travelmapping.net/index.php?topic=4633)
NY: NY-324's 'western' end (https://forum.travelmapping.net/index.php?topic=4635)

Ongoing operations:
NE: Operation Log Book 2020 (https://forum.travelmapping.net/index.php?topic=4498)
Operation Directional Prefix (http://forum.travelmapping.net/index.php?topic=62.msg15512#msg15512)

Need more info (check sources):
NY: NY 124 North End (http://forum.travelmapping.net/index.php?topic=3481)
RI 238 to Goat Island (http://forum.travelmapping.net/index.php?topic=2726)
KS: El Dorado Truck Routes (http://tm.teresco.org/forum/index.php?topic=2260)
US20Bus (South Sioux City, NE) (no thread)

Need more info (not available yet):
KS 99 Truck (Wamego) (https://forum.travelmapping.net/index.php?topic=5625)
KS: KS 7 rerouting in Olathe (http://tm.teresco.org/forum/index.php?topic=2081)
NE: S57A extends a bit further east (https://forum.travelmapping.net/index.php?topic=4686)

Very low priority:
NH:  NH 38 in Salem (http://tm.teresco.org/forum/index.php?topic=294)
RI: T.F. Green Airport Connector (http://tm.teresco.org/forum/index.php?topic=2047)
Title: Re: yakra's collaborator thread
Post by: yakra on June 01, 2016, 01:54:46 am
Eric's Patented Colo(u)r Code
Wot, spell "bolour" with a 'k'?"

I color-code a lot of my ToDo lists as an organizational tool, and then edit the hell out of my posts as my work progresses.
Colo(u)r coding usually (but not always) means:

Red: ToDo; not yet addressed.
Magenta: Work in progress.
Purple: Work saved locally; ready to submit.
Blue: Committed to GitHub.
Cyan: Pull request submitted; not updated on-site yet.
Green: Completely complete.
Gold: I looked into this and determined no changes needed to be made. This is hard to read. Sorry.

Sometimes I engage in "off-label" usage of the colors for meanings other than the above, in ways that make sense to me. Yeah. Sorry.
I'll try to add some notes to posts that need them if I need to publicly clarify.

Nota Bene: Back in the CHM days, there was no GitHub step to the process involved. On the old forum, I used blue for what's now purple. There could still be some lingering posts here from before I moved away from the old color-coding convention. In a perfect world, they'll get edited.


Edit, 2019-12-20:
My use of color coding is evolving... As I see it now, there are more potential stages to the pipeline than colors I've been using...
1. ToDo; not yet addressed.
2. Work in progress, not saved yet.
3. Saved, in dirty working directory.
4. Saved & stashed.
5. Staged for commit.
6. Committed to local repo, not pushed yet.
7. Pushed to GitHub, no PR yet.
8. Pull request opened; not updated on-site yet.
9. Completely complete.
So, this is leading to some inconsistent usage; I've not standardized on anything yet.


Edit, 2021-05-05:
Still evolving. Steps 2-7 fly past so quickly that there's little point in making that many edits to a post to row through a long list of colors. Work is rarely saved in a partially-completed state.
These days, I pretty much start at red for step 1, go green when opening a pull request, which will be merged before too long.
Title: Re: yakra's collaborator thread
Post by: yakra on November 06, 2016, 02:05:08 am
Operation NMPs

nb   clean; no FPs
ne   clean; no FPs
pa   clean; no FPs
nh   clean; no FPs
ab   clean; no FPs
me   clean; no FPs
ok   clean; no FPs
ar   clean; no FPs
nd   clean; no FPs
md   clean; no FPs

ri   clean; FPs logged
ns   clean; FPs logged
nj   clean; FPs logged
ma   clean; FPs logged
pe   clean; FPs logged
ct   clean; FPs logged
tx   clean; FPs logged

dc   clean; multiplex break on VA side
ks   clean; both entries must be dealt with on the MO side

ny   has been moved to its own thread (http://tm.teresco.org/forum/index.php?topic=1885)

Code: [Select]
ct.ct002 25 (41.561443,-72.126854) NMP ct.ct032 CT2(25) (41.561442,-72.126853) [LOOKS INTENTIONAL]
ct.ct032 CT2(25) (41.561442,-72.126853) NMP ct.ct002 25 (41.561443,-72.126854) [LOOKS INTENTIONAL]
ct.i095 86 (41.364536,-72.067612) NMP ct.us001 I-95(86) (41.364535,-72.067612) [LOOKS INTENTIONAL]
ct.us001 I-95(86) (41.364535,-72.067612) NMP ct.i095 86 (41.364536,-72.067612) ct.ct012 I-95 (41.364536,-72.067612) [LOOKS INTENTIONAL]
ct.ct012 I-95 (41.364536,-72.067612) NMP ct.us001 I-95(86) (41.364535,-72.067612) [LOOKS INTENTIONAL]
ct.i095 83 (41.366318,-72.108845) NMP ct.us001 I-95(83) (41.366319,-72.108845) [LOOKS INTENTIONAL]
ct.us001 I-95(83) (41.366319,-72.108845) NMP ct.i095 83 (41.366318,-72.108845) [LOOKS INTENTIONAL]
ct.i091 17 (41.521788,-72.77141) NMP ct.ct015 67S (41.521789,-72.77141) [LOOKS INTENTIONAL]
ct.i091 17A (41.532599,-72.768492) NMP ct.ct015 68N-E (41.532598,-72.768492) [LOOKS INTENTIONAL]
ct.ct015 67S (41.521789,-72.77141) NMP ct.i091 17 (41.521788,-72.77141) [LOOKS INTENTIONAL]
ct.ct015 68N-E (41.532598,-72.768492) NMP ct.i091 17A (41.532599,-72.768492) [LOOKS INTENTIONAL]

ma.us006 BriSt (41.722339,-71.152568) NMP ma.ma079 *BriSt (41.722339,-71.152567) [LOOKS INTENTIONAL]
ma.us006 MA79/138 [alt: ['+MA138_S']] (41.716549,-71.154993) NMP ma.ma079 US6_E (41.716549,-71.154992) ma.ma138 US6_E (41.716549,-71.154992) [LOOKS INTENTIONAL]
ma.ma079 US6_E (41.716549,-71.154992) NMP ma.us006 MA79/138 [alt: ['+MA138_S']] (41.716549,-71.154993) [LOOKS INTENTIONAL]
ma.ma079 *BriSt (41.722339,-71.152567) NMP ma.us006 BriSt (41.722339,-71.152568) ma.ma138 BriSt (41.722339,-71.152568) [LOOKS INTENTIONAL]
ma.ma138 US6_E (41.716549,-71.154992) NMP ma.us006 MA79/138 [alt: ['+MA138_S']] (41.716549,-71.154993) [LOOKS INTENTIONAL]
ma.ma138 BriSt (41.722339,-71.152568) NMP ma.ma079 *BriSt (41.722339,-71.152567) [LOOKS INTENTIONAL]

nj.nj024 8 (40.733357,-74.354032) NMP nj.nj124 SumRd (40.733358,-74.354031) [LOOKS INTENTIONAL]
nj.nj024 9B (40.727434,-74.34538) NMP nj.nj124 HobGapRd (40.727434,-74.345381) [LOOKS INTENTIONAL]
nj.nj124 SumRd (40.733358,-74.354031) NMP nj.nj024 8 (40.733357,-74.354032) [LOOKS INTENTIONAL]
nj.nj124 HobGapRd (40.727434,-74.345381) NMP nj.nj024 9B (40.727434,-74.34538) [LOOKS INTENTIONAL]

ns.ns111 6B (44.681562,-63.544986) NMP ns.ns007 NS111(6B) (44.681563,-63.544987) [LOOKS INTENTIONAL]
ns.ns007 NS111(6B) (44.681563,-63.544987) NMP ns.ns111 6B (44.681562,-63.544986) [LOOKS INTENTIONAL]

pe.pe017a PE324_W (46.074434,-62.525737) NMP pe.pe017a PE324_E (46.074533,-62.525762) pe.pe324 PE17A_N (46.074533,-62.525762)
pe.pe017a PE324_E (46.074533,-62.525762) NMP pe.pe017a PE324_W (46.074434,-62.525737) pe.pe324 PE17A_S (46.074434,-62.525737)
pe.pe324 PE17A_S (46.074434,-62.525737) NMP pe.pe017a PE324_E (46.074533,-62.525762) pe.pe324 PE17A_N (46.074533,-62.525762)
pe.pe324 PE17A_N (46.074533,-62.525762) NMP pe.pe017a PE324_W (46.074434,-62.525737) pe.pe324 PE17A_S (46.074434,-62.525737)
pe.pe020 PE104_N (46.512454,-63.680382) NMP pe.pe020 PE103_W [alt: ['+PE103/104']] (46.512525,-63.680422) pe.pe103 PE20_W (46.512525,-63.680422)
pe.pe020 PE103_W [alt: ['+PE103/104']] (46.512525,-63.680422) NMP pe.pe020 PE104_N (46.512454,-63.680382) pe.pe104 PE20_N [alt: ['+PE20/103']] (46.512454,-63.680382)
pe.pe103 PE20_W (46.512525,-63.680422) NMP pe.pe020 PE104_N (46.512454,-63.680382) pe.pe104 PE20_N [alt: ['+PE20/103']] (46.512454,-63.680382)
pe.pe104 PE20_N [alt: ['+PE20/103']] (46.512454,-63.680382) NMP pe.pe020 PE103_W [alt: ['+PE103/104']] (46.512525,-63.680422) pe.pe103 PE20_W (46.512525,-63.680422)

ri.i095 19 (41.812834,-71.406948) NMP ri.i195 1 (41.812835,-71.406949) ri.us006 I-195(1) [alt: ['+I-195(1B)']] (41.812835,-71.406949) [LOOKS INTENTIONAL]
ri.i195 1 (41.812835,-71.406949) NMP ri.i095 19 (41.812834,-71.406948) [LOOKS INTENTIONAL]
ri.us006 I-195(1) [alt: ['+I-195(1B)']] (41.812835,-71.406949) NMP ri.i095 19 (41.812834,-71.406948) [LOOKS INTENTIONAL]

tx.i040blama US87 (35.222021,-101.830984) NMP tx.us287 I-40BL/60 [alt: ['+US60_E']] (35.222021,-101.830985) [LOOKS INTENTIONAL]
tx.us087 I-40BL/60 [alt: ['+US60_E']] (35.222021,-101.830984) NMP tx.us287 I-40BL/60 [alt: ['+US60_E']] (35.222021,-101.830985) [LOOKS INTENTIONAL]
tx.us287 I-40BL/60 [alt: ['+US60_E']] (35.222021,-101.830985) NMP tx.i040blama US87 (35.222021,-101.830984) tx.us087 I-40BL/60 [alt: ['+US60_E']] (35.222021,-101.830984) [LOOKS INTENTIONAL]
tx.us087 TXLp279 (35.207201,-101.833913) NMP tx.us287 TXLp279 (35.207201,-101.833914) [LOOKS INTENTIONAL]
tx.us287 TXLp279 (35.207201,-101.833914) NMP tx.us087 TXLp279 (35.207201,-101.833913) tx.lp279 US87 (35.207201,-101.833913) [LOOKS INTENTIONAL]
tx.lp279 US87 (35.207201,-101.833913) NMP tx.us287 TXLp279 (35.207201,-101.833914) [LOOKS INTENTIONAL]
tx.us087 TXLp395 (35.203107,-101.834728) NMP tx.us287 TXLp395 (35.203107,-101.834729) tx.lp395 US287 (35.203107,-101.834729) [LOOKS INTENTIONAL]
tx.us287 TXLp395 (35.203107,-101.834729) NMP tx.us087 TXLp395 (35.203107,-101.834728) [LOOKS INTENTIONAL]
tx.lp395 US287 (35.203107,-101.834729) NMP tx.us087 TXLp395 (35.203107,-101.834728) [LOOKS INTENTIONAL]
tx.geobushtpk IndPkwy (33.003245,-96.748264) NMP tx.tx190pla IndPkwy (33.003246,-96.748264) [LOOKS INTENTIONAL]
tx.geobushtpk CusPkwy (33.003832,-96.73206) NMP tx.tx190pla CusPkwy (33.003832,-96.732059) [LOOKS INTENTIONAL]
tx.geobushtpk AlmaRd (33.004005,-96.716157) NMP tx.tx190pla AlmaRd (33.004004,-96.716157) [LOOKS INTENTIONAL]
tx.geobushtpk US75 (33.003958,-96.708162) NMP tx.tx190 US75 (33.003958,-96.708163) [LOOKS INTENTIONAL]
tx.us075 GeoBushTpke (33.003958,-96.708162) NMP tx.tx190 US75 (33.003958,-96.708163) [LOOKS INTENTIONAL]
tx.tx190pla IndPkwy (33.003246,-96.748264) NMP tx.geobushtpk IndPkwy (33.003245,-96.748264) [LOOKS INTENTIONAL]
tx.tx190pla CusPkwy (33.003832,-96.732059) NMP tx.geobushtpk CusPkwy (33.003832,-96.73206) [LOOKS INTENTIONAL]
tx.tx190pla AlmaRd (33.004004,-96.716157) NMP tx.geobushtpk AlmaRd (33.004005,-96.716157) [LOOKS INTENTIONAL]
tx.tx190 US75 (33.003958,-96.708163) NMP tx.geobushtpk US75 (33.003958,-96.708162) tx.us075 GeoBushTpke (33.003958,-96.708162) [LOOKS INTENTIONAL]
tx.geobushtpk JupRd (33.002624,-96.682289) NMP tx.tx190 JupRd (33.002623,-96.682289) [LOOKS INTENTIONAL]
tx.tx190 JupRd (33.002623,-96.682289) NMP tx.geobushtpk JupRd (33.002624,-96.682289) [LOOKS INTENTIONAL]
tx.geobushtpk CoitRd (32.999461,-96.767803) NMP tx.tx190pla CoitRd (32.99946,-96.767803) [LOOKS INTENTIONAL]
tx.tx190pla CoitRd (32.99946,-96.767803) NMP tx.geobushtpk CoitRd (32.999461,-96.767803) [LOOKS INTENTIONAL]
tx.geobushtpk RenRd (32.997075,-96.67089) NMP tx.tx190 RenRd (32.997075,-96.670891) [LOOKS INTENTIONAL]
tx.tx190 RenRd (32.997075,-96.670891) NMP tx.geobushtpk RenRd (32.997075,-96.67089) [LOOKS INTENTIONAL]
tx.i035e 445 (32.981848,-96.930056) NMP tx.tx190car I-35E (32.981848,-96.930057) [LOOKS INTENTIONAL]
tx.geobushtpk I-35E (32.981848,-96.930056) NMP tx.tx190car I-35E (32.981848,-96.930057) [LOOKS INTENTIONAL]
tx.geobushtpk OldDenRd (32.983243,-96.909875) NMP tx.tx190car OldDenRd (32.983242,-96.909875) [LOOKS INTENTIONAL]
tx.geobushtpk JosLn (32.985457,-96.890477) NMP tx.tx190car JosLn (32.985457,-96.890478) [LOOKS INTENTIONAL]
tx.geobushtpk KelBlvd (32.986242,-96.869006) NMP tx.tx190car KelBlvd (32.986242,-96.869005) [LOOKS INTENTIONAL]
tx.geobushtpk LooDr (32.982496,-96.664906) NMP tx.tx190 LooDr (32.982495,-96.664906) [LOOKS INTENTIONAL]
tx.us077 I-35E(445) (32.981848,-96.930056) NMP tx.tx190car I-35E (32.981848,-96.930057) [LOOKS INTENTIONAL]
tx.tx190car I-35E (32.981848,-96.930057) NMP tx.i035e 445 (32.981848,-96.930056) tx.geobushtpk I-35E (32.981848,-96.930056) tx.us077 I-35E(445) (32.981848,-96.930056) [LOOKS INTENTIONAL]
tx.tx190car OldDenRd (32.983242,-96.909875) NMP tx.geobushtpk OldDenRd (32.983243,-96.909875) [LOOKS INTENTIONAL]
tx.tx190car JosLn (32.985457,-96.890478) NMP tx.geobushtpk JosLn (32.985457,-96.890477) [LOOKS INTENTIONAL]
tx.tx190car KelBlvd (32.986242,-96.869005) NMP tx.geobushtpk KelBlvd (32.986242,-96.869006) [LOOKS INTENTIONAL]
tx.tx190 LooDr (32.982495,-96.664906) NMP tx.geobushtpk LooDr (32.982496,-96.664906) [LOOKS INTENTIONAL]
tx.geobushtpk CamRd (32.975222,-96.657036) NMP tx.tx190 CamRd (32.975222,-96.657037) [LOOKS INTENTIONAL]
tx.tx190 CamRd (32.975222,-96.657037) NMP tx.geobushtpk CamRd (32.975222,-96.657036) [LOOKS INTENTIONAL]
tx.geobushtpk GarAve (32.966061,-96.642096) NMP tx.tx190 GarAve (32.966062,-96.642096) [LOOKS INTENTIONAL]
tx.tx190 GarAve (32.966062,-96.642096) NMP tx.geobushtpk GarAve (32.966061,-96.642096) [LOOKS INTENTIONAL]
tx.geobushtpk BraRd (32.957124,-96.629981) NMP tx.tx190 BraRd (32.957124,-96.62998) [LOOKS INTENTIONAL]
tx.tx190 BraRd (32.957124,-96.62998) NMP tx.geobushtpk BraRd (32.957124,-96.629981) [LOOKS INTENTIONAL]
tx.geobushtpk LasColBlvd (32.90826,-96.952771) NMP tx.tx161irv LasColBlvd (32.90826,-96.952772) [LOOKS INTENTIONAL]
tx.tx161irv LasColBlvd (32.90826,-96.952772) NMP tx.geobushtpk LasColBlvd (32.90826,-96.952771) [LOOKS INTENTIONAL]
tx.geobushtpk MacArtBlvd (32.904429,-96.958758) NMP tx.tx161irv MacArtBlvd (32.90443,-96.958758) [LOOKS INTENTIONAL]
tx.tx161irv MacArtBlvd (32.90443,-96.958758) NMP tx.geobushtpk MacArtBlvd (32.904429,-96.958758) [LOOKS INTENTIONAL]
tx.geobushtpk TX114 (32.895581,-96.972193) NMP tx.tx161irv TX114 (32.895582,-96.972193) [LOOKS INTENTIONAL]
tx.tx114 GeoBushTpk (32.895581,-96.972193) NMP tx.tx161irv TX114 (32.895582,-96.972193) [LOOKS INTENTIONAL]
tx.tx161irv TX114 (32.895582,-96.972193) NMP tx.geobushtpk TX114 (32.895581,-96.972193) tx.tx114 GeoBushTpk (32.895581,-96.972193) [LOOKS INTENTIONAL]
tx.geobushtpk NBeltLineRd (32.877648,-96.991513) NMP tx.tx161irv BeltLineRd (32.877647,-96.991513) [LOOKS INTENTIONAL]
tx.tx161irv BeltLineRd (32.877647,-96.991513) NMP tx.geobushtpk NBeltLineRd (32.877648,-96.991513) [LOOKS INTENTIONAL]
tx.geobushtpk WalHillLn (32.865904,-97.002612) NMP tx.tx161irv WalHillLn (32.865904,-97.002613) [LOOKS INTENTIONAL]
tx.tx161irv WalHillLn (32.865904,-97.002613) NMP tx.geobushtpk WalHillLn (32.865904,-97.002612) [LOOKS INTENTIONAL]
tx.geobushtpk NorDr (32.857043,-97.013156) NMP tx.tx161irv NorDr (32.857043,-97.013157) [LOOKS INTENTIONAL]
tx.tx161irv NorDr (32.857043,-97.013157) NMP tx.geobushtpk NorDr (32.857043,-97.013156) [LOOKS INTENTIONAL]
tx.geobushtpk RocRd (32.845263,-97.016779) NMP tx.tx161irv RocRd (32.845263,-97.01678) [LOOKS INTENTIONAL]
tx.tx161irv RocRd (32.845263,-97.01678) NMP tx.geobushtpk RocRd (32.845263,-97.016779) [LOOKS INTENTIONAL]
tx.geobushtpk ShaGroRd (32.80345,-97.018397) NMP tx.tx161sir ShaGroRd (32.803449,-97.018397) [LOOKS INTENTIONAL]
tx.tx161sir ShaGroRd (32.803449,-97.018397) NMP tx.geobushtpk ShaGroRd (32.80345,-97.018397) [LOOKS INTENTIONAL]
tx.geobushtpk OakRd (32.792456,-97.018536) NMP tx.tx161sir OakRd (32.792455,-97.018536) [LOOKS INTENTIONAL]
tx.tx161sir OakRd (32.792455,-97.018536) NMP tx.geobushtpk OakRd (32.792456,-97.018536) [LOOKS INTENTIONAL]
tx.geobushtpk LowTarRd (32.778678,-97.025955) NMP tx.tx161 LowTarRd (32.778677,-97.025955) [LOOKS INTENTIONAL]
tx.tx161 LowTarRd (32.778677,-97.025955) NMP tx.geobushtpk LowTarRd (32.778678,-97.025955) [LOOKS INTENTIONAL]
tx.i030 45A (32.771397,-96.811144) NMP tx.i035e 428D [alt: ['+428C']] (32.771398,-96.811144) tx.us077 I-35E(428D) [alt: ['+I-35E(428C)']] (32.771398,-96.811144) [LOOKS INTENTIONAL]
tx.i035e 428D [alt: ['+428C']] (32.771398,-96.811144) NMP tx.i030 45A (32.771397,-96.811144) [LOOKS INTENTIONAL]
tx.us077 I-35E(428D) [alt: ['+I-35E(428C)']] (32.771398,-96.811144) NMP tx.i030 45A (32.771397,-96.811144) [LOOKS INTENTIONAL]
tx.geobushtpk EgyWay (32.764881,-97.02919) NMP tx.tx161 EgyWay (32.764881,-97.029189) [LOOKS INTENTIONAL]
tx.tx161 EgyWay (32.764881,-97.029189) NMP tx.geobushtpk EgyWay (32.764881,-97.02919) [LOOKS INTENTIONAL]
tx.i030 32 (32.759526,-97.029276) NMP tx.tx161 I-30 (32.759526,-97.029275) [LOOKS INTENTIONAL]
tx.geobushtpk I-30(32) (32.759526,-97.029276) NMP tx.tx161 I-30 (32.759526,-97.029275) [LOOKS INTENTIONAL]
tx.tx161 I-30 (32.759526,-97.029275) NMP tx.i030 32 (32.759526,-97.029276) tx.geobushtpk I-30(32) (32.759526,-97.029276) [LOOKS INTENTIONAL]
tx.geobushtpk TX180 (32.741709,-97.020226) NMP tx.tx161 TX180 (32.741709,-97.020225) [LOOKS INTENTIONAL]
tx.tx161 TX180 (32.741709,-97.020225) NMP tx.geobushtpk TX180 (32.741709,-97.020226) tx.tx180 GeoBushTpk (32.741709,-97.020226) [LOOKS INTENTIONAL]
tx.tx180 GeoBushTpk (32.741709,-97.020226) NMP tx.tx161 TX180 (32.741709,-97.020225) [LOOKS INTENTIONAL]
tx.geobushtpk MarDr (32.721118,-97.022656) NMP tx.tx161 MarDr (32.721118,-97.022655) [LOOKS INTENTIONAL]
tx.tx161 MarDr (32.721118,-97.022655) NMP tx.geobushtpk MarDr (32.721118,-97.022656) [LOOKS INTENTIONAL]
tx.geobushtpk TXSpr303 (32.70988,-97.024732) NMP tx.tx161 TXSpr303 (32.70988,-97.024731) [LOOKS INTENTIONAL]
tx.tx161 TXSpr303 (32.70988,-97.024731) NMP tx.geobushtpk TXSpr303 (32.70988,-97.024732) tx.sp303 GeoBushTpk (32.70988,-97.024732) [LOOKS INTENTIONAL]
tx.sp303 GeoBushTpk (32.70988,-97.024732) NMP tx.tx161 TXSpr303 (32.70988,-97.024731) [LOOKS INTENTIONAL]
tx.geobushtpk MayRd (32.691783,-97.024426) NMP tx.tx161 MayRd (32.691783,-97.024425) [LOOKS INTENTIONAL]
tx.tx161 MayRd (32.691783,-97.024425) NMP tx.geobushtpk MayRd (32.691783,-97.024426) [LOOKS INTENTIONAL]
tx.us183 TX45/130 (30.081542,-97.692662) NMP tx.tx045 TX130(458) (30.081542,-97.692661) tx.tx130 458 (30.081542,-97.692661) [LOOKS INTENTIONAL]
tx.tx045 TX130(458) (30.081542,-97.692661) NMP tx.us183 TX45/130 (30.081542,-97.692662) [LOOKS INTENTIONAL]
tx.tx130 458 (30.081542,-97.692661) NMP tx.us183 TX45/130 (30.081542,-97.692662) [LOOKS INTENTIONAL]
tx.us183 OldLocRd (30.043994,-97.689712) NMP tx.tx130 460 (30.043994,-97.689711) [LOOKS INTENTIONAL]
tx.tx130 460 (30.043994,-97.689711) NMP tx.us183 OldLocRd (30.043994,-97.689712) [LOOKS INTENTIONAL]
tx.us183 TX21 (30.027758,-97.687909) NMP tx.tx130 461 (30.027758,-97.687908) [LOOKS INTENTIONAL]
tx.tx021 US183/130 (30.027758,-97.687909) NMP tx.tx130 461 (30.027758,-97.687908) [LOOKS INTENTIONAL]
tx.tx130 461 (30.027758,-97.687908) NMP tx.us183 TX21 (30.027758,-97.687909) tx.tx021 US183/130 (30.027758,-97.687909) [LOOKS INTENTIONAL]
tx.us183 HomTr (30.005183,-97.687148) NMP tx.tx130 465 (30.005183,-97.687147) [LOOKS INTENTIONAL]
tx.tx130 465 (30.005183,-97.687147) NMP tx.us183 HomTr (30.005183,-97.687148) [LOOKS INTENTIONAL]
tx.us183 SchRd (29.967976,-97.677932) NMP tx.tx130 464 (29.967976,-97.677931) [LOOKS INTENTIONAL]
tx.tx130 464 (29.967976,-97.677931) NMP tx.us183 SchRd (29.967976,-97.677932) [LOOKS INTENTIONAL]
tx.us183 FM1185 (29.9513,-97.674257) NMP tx.tx130 466 (29.9513,-97.674256) [LOOKS INTENTIONAL]
tx.tx130 466 (29.9513,-97.674256) NMP tx.us183 FM1185 (29.9513,-97.674257) [LOOKS INTENTIONAL]
tx.us183 TX130 (29.914834,-97.68114) NMP tx.tx130 470 (29.914834,-97.681139) [LOOKS INTENTIONAL]
tx.tx130 470 (29.914834,-97.681139) NMP tx.us183 TX130 (29.914834,-97.68114) [LOOKS INTENTIONAL]
tx.i010 768A (29.77734,-95.369568) NMP tx.i045 48B (29.777341,-95.369568) [LOOKS INTENTIONAL]
tx.i045 48B (29.777341,-95.369568) NMP tx.i010 768A (29.77734,-95.369568) tx.us090 I-10(768A) (29.77734,-95.369568) [LOOKS INTENTIONAL]
tx.us090 I-10(768A) (29.77734,-95.369568) NMP tx.i045 48B (29.777341,-95.369568) [LOOKS INTENTIONAL]
tx.i002 DixRd (26.188369,-97.721715) NMP tx.us083busmca DixRd (26.188368,-97.721715) [LOOKS INTENTIONAL]
tx.us083 DixRd (26.188369,-97.721715) NMP tx.us083busmca DixRd (26.188368,-97.721715) [LOOKS INTENTIONAL]
tx.us083busmca DixRd (26.188368,-97.721715) NMP tx.i002 DixRd (26.188369,-97.721715) tx.us083 DixRd (26.188369,-97.721715) [LOOKS INTENTIONAL]
Title: Re: yakra's collaborator thread
Post by: yakra on November 16, 2016, 02:00:44 pm
Nova Scotia

http://www.novascotia.ca/tran/publications/primary%20traffic%20volume%20book%202005-2014.pdf
Title: Re: yakra's collaborator thread
Post by: yakra on June 06, 2017, 01:33:52 am
Operation UnusedAltLabels

Quote from: yakra on December 03, 2016, 05:08:43 pm
I personally won't make an "Operation" out of this,
Making a liar out of myself, evidently?

Canada:
AB   3 <--3 in AB1 & 2 in AB16 left in, to maintain identical files with TCHMai & TCHYel respectively
MB   1
NB   6
NL   1
NS   2
PE   3 <--PE1 Fry left in, to maintain identical file with TCHPEI
total   15

New England:
CT   8
MA   6
ME   5
NH   3
RI   6
total   28

New York:
usai   5
usaif   2
usaus   6
usany   18
total   31

Central States:
KS   18
NE   7
OK   19
total   44

Texas:
usai   11
usaib   3
usaus   26
usausb   4
usatx   5
usatxl   6
usatxs   1
total   56

Unclaimed regions:
DC   3
DE   7
MD   21 (http://tm.teresco.org/forum/index.php?topic=2058)
ND   9
NJ   15
PA   38 (https://github.com/TravelMapping/HighwayData/pull/1748)
total   62

Fold into Operation AR Cleanup:
AR   14
Title: Re: yakra's collaborator thread
Post by: yakra on June 08, 2017, 11:46:23 am
Operation NMP 500

No FPs last time; start right in:
ne   all FPs; add to log
ab   3 3A 21 49 52   (No NMPs!)
nb   119 148 505   Mark FPs
nh   1B 10 13 25 25B 31 110A 113 114 125 175 202A   Mark FPs
North Dakota
  coordinate with oscar
  I-29/US81@SD/ND vs I-29(1)/US81 -- just mark false positive
  nd.nd017@ND/MN: resync to mn.mn317@ND/MN
  sd.sd075@SD/ND matches the border in ESRI view; HAIL ERIS; resync nd.nd008@SD/ND
Maine
  yakra.list: ME ME149 RivSt ME145 -> ME ME149 ME234_E ME145
  DATACHECK me.i095;291;302;;VISIBLE_DISTANCE;10.79
  Mark FPs
ok   Mark FPs
mb   (No NMPs!)
Delaware
  coordinate with rickmastfan67?
  Mark FPs
pa
Maryland
  more edits
  coordinate with rickmastfan67
  Mark FPs

FPs to be backed out:
ri   Mark FPs
ns   Mark FPs
ma   Mark FPs
nj   Mark FPs
Connecticut
  Mark FPs
  291/159/218
  5/9/15/372?
Texas
  resync TXSpr280 & US287BusFtW; check for new FPs (None).
  recenter ChiTrlPkwy@ForParkBlvd; moved points just far enough apart (.000526) to avoid flagging as NMP
pe   Mark FPs
New York
  Auburn: 20/5/34/38 area
  datacheck
  mark FPs

Border entries affecting adjacent region:
dc   Everything's on the VA side. Not going to bother marking any FPs.
ks   mark FPs (leaving MO border unmarked, pending any fixes Jeff may choose to do)

Fold into Operation AR Cleanup:
ar

Confirm that everything's flagged as FP:
ne ab nb nh nd me ok mb de pa md ri ns ma nj ct tx pe ny ks
nh: ping froggie re vt FPs
nd: edits pending
ok: ping Jeff Morrison re mo FPs
Code: [Select]
mo.mo043 AR/MO (36.499462,-94.617683) NMP ok.ok020 OK/AR [alt: ['+OK/MO']] (36.499167,-94.61782)

sd.i029 SD/ND [alt: ['+999']] (45.935631,-96.843582) NMP nd.i029 1 (45.935887,-96.843466) nd.us081 I-29(1) (45.935887,-96.843466)
sd.us081 SD/ND (45.935631,-96.843582) NMP nd.i029 1 (45.935887,-96.843466) nd.us081 I-29(1) (45.935887,-96.843466) md: ping rickmastfan67 re wv FPs
ct: 5/9/15/372; Mark results
ks: http://tm.teresco.org/forum/index.php?topic=2155
Title: Re: yakra's collaborator thread
Post by: yakra on August 23, 2017, 03:55:24 am
Roadmap

canmbw: Preview (http://tm.teresco.org/forum/index.php?topic=1846.msg8535#msg8535)
canabs: Preview (http://tm.teresco.org/forum/index.php?topic=2169.msg9276#msg9276)
usanyp: Preview (https://github.com/TravelMapping/HighwayData/pull/2039)
canmbp: Preview (https://github.com/TravelMapping/HighwayData/pull/2120)

cannl peer review
usaar peer review
cannss
Title: Re: yakra's collaborator thread
Post by: yakra on October 25, 2017, 01:52:06 pm
GIS side projects:

delete variables once no longer needed

add numeric field support
Field decimal count in binary: applicable for type N & F fields.
GISplunge, DBFtrim

GISplunge:
GISplunge Bugs (http://tm.teresco.org/forum/index.php?topic=9.msg4363#msg4363)
add numeric field support
signed char bug? possibly not? Gone either way; DBFheader function replaced with DBF.h

DBFmine:
signed char bug(FieldLength) fixed 20171103
output commandline to output.txt
header files
numeric field support

DBFcull:
fix signed char bug
header files

DBFtrim:
add numeric field support
type N fields: trim extraneous trailing '0's
check out that Arkansas newline in hex editor

header files:
DBFcull, DBFmine, GISplunge
Title: Re: yakra's collaborator thread
Post by: yakra on September 03, 2018, 12:45:52 pm
Operation New-style NMP
http://forum.travelmapping.net/index.php?topic=335.msg10977#msg10977
USA: CT KS MA ME NE NH NJ NY OK RI TX ... AZ DC DE MD
CAN: AB MB NB NS PE NL

CT: all marked FP
KS: extraneous point in MO (http://forum.travelmapping.net/index.php?topic=2664)
MA: 2 non-FP pairs in Fall River (https://github.com/TravelMapping/HighwayData/pull/2186/commits/6f1ac6dbda3ab122813140fb270cd4b92f2a0f56)
ME: all marked FP
NE: all marked FP
NH: all marked FP
NJ: all marked FP
NY: 1 actual FP (https://github.com/yakra/HighwayData/commit/ed74d67495cc35f39c680d408a3385dd62792e50); 3 from a point coord error (https://github.com/TravelMapping/HighwayData/pull/2191/commits/94421f5a1ba59f624f03b30cf8d148d540c7b302)
OK: 1 half-marked pair; would require flagging a point in AR
RI: all marked FP
TX: 2 half-marked pairs; would require flagging a point in NM
...
AZ: 1 (https://github.com/TravelMapping/HighwayData/pull/2193), 2 (https://github.com/TravelMapping/HighwayData/pull/2194), CA (http://forum.travelmapping.net/index.php?topic=2670)
DC: everything is @ VA border
DE: all marked FP
MD: all marked FP

AB: no NMPs
MB: all marked FP
NB: all marked FP
NS: all marked FP
PE: 3 non-FP pairs (https://github.com/yakra/HighwayData/commit/ea4fb47e0498234b7875f64c74da647f7119cdda)
NL: no NMPs
Title: Re: yakra's collaborator thread
Post by: yakra on September 19, 2018, 02:21:15 pm
Texas Loops missing graph connections at one or more ends
in case I want to cite them as an example of something in the future

I-40BLAdr (http://travelmapping.net/hb/index.php?r=tx.i040bladr) @ both ends
TXLp353 (http://travelmapping.net/hb/index.php?r=tx.lp353) @ I-35(154A)
TXLp395 (http://travelmapping.net/hb/index.php?r=tx.lp395) @ I-40
TXLp434 (http://travelmapping.net/hb/index.php?r=tx.lp434) @ US87/287_N
TXLp478 (http://travelmapping.net/hb/index.php?r=tx.lp478) @ US62
TXLp522 (http://travelmapping.net/hb/index.php?r=tx.lp522) @ US59_S

Not at a terminus, just oddball:
TXLp354 (http://travelmapping.net/hb/index.php?r=tx.lp354) @ I-635

Not checked for further examples: usausb (http://travelmapping.net/hb/?rg=tx&sys=usausb), usatxs (http://travelmapping.net/hb/?rg=tx&sys=usatxs)
Title: Re: yakra's collaborator thread
Post by: yakra on October 17, 2018, 01:02:06 pm
Operation Autoshape

No [LOOKS INTENTIONAL] NMPs:
AB MB NB PE NL
KS ME NE NH OK

Points to resync:
NS cannst ns.ns007 NS111(6B)
NJ usanj nj.nj024 8 9B
RI usai ri.i095 19
RI usari ri.ri114 RI15_W
MA usaus ma.us006 MA79/138
MA usama ma.ma079 *BriSt
CT usai ct.i091 17
CT usaus ct.us001 I-95(83) I-95(86)
CT usact ct.ct015 68N-E
CT usact ct.ct032 CT2(25)
NY usai ny.i095 6A
NY usai ny.i787 4
NY usany ny.ny027 I-678 JFKExpy RocBlvd FarBlvd SprBlvd
TX usai tx.i030 45A
TX usai tx.i045 48B
TX usai tx.i169 BakLn (Should be concurrent!)
TX usaus tx.us087 TXLp395
TX usaus tx.us183 TX130 FM1185 SchRd HomTr OldLocRd TX45/130
TX usaus tx.us287 TXLp279 I-40BL/60
TX usausb tx.us083busmca DixRd
TX usatx tx.tx130 461
TX usatx tx.tx161 MayRd TXSpr303 MarDr TX180 I-30 EgyWay LowTarRd
TX usatx tx.tx161sir OakRd ShaGroRd
TX usatx tx.tx161irv RocRd NorDr WalHillLn BeltLineRd TX114 MacArtBlvd LasColBlvd
TX usatx tx.tx190car I-35E OldDenRd JosLn KelBlvd
TX usatx tx.tx190pla CoitRd IndPkwy CusPkwy AlmaRd
TX usatx tx.tx190 US75 JupRd RenRd LooDr CamRd GarAve BraRd

autoshape.ini:
NS cannst ns.ns007 NS111(6A)
NJ usanj nj.nj124 SumAve
RI usaus ri.us006 I-95(20)
RI usari ri.ri114 RI15_E
MA usaus ma.us006 BriSt    <--Manually use 2nd-best point, to avoid FP plex with MA138
MA usama ma.ma079 *BriSt
MA usama ma.ma138 US6_E
CT usaus ct.us001 I-95(83) I-95(85)
CT usact ct.ct015 67S 67
CT usact ct.ct032 CT2(26)
NY usai ny.i095 6A
NY usaus ny.us009 I-787(3)
NY usany ny.ny027 I-678 JFKExpy RocBlvd FarBlvd SprBlvd
TX usai tx.i030 45A
TX usai tx.i045 48A
TX usaus tx.us183 TX130 FM1185 SchRd HomTr TX21 OldLocRd TX45/130
TX usaus tx.us287 US60/87 TXLp395 TXLp279 I-40BL/60
TX usausb tx.us083busmca US83_S
TX usatx tx.tx161 I-20 MayRd TXSpr303 MarDr TX180 I-30 EgyWay
TX usatx tx.tx161sir OakRd
TX usatx tx.tx161irv TX183 RocRd NorDr WalHillLn BeltLineRd TX114 MacArtBlvd
TX usatx tx.tx190car I-35E OldDenRd JosLn
TX usatx tx.tx190pla CoitRd IndPkwy CusPkwy
TX usatx tx.tx190 US75 JupRd RenRd LooDr CamRd GarAve

LOL River MESSachusetts:
North of Brightman St:
• US6 & MA138 concurrent on ramps
• MA79 solo on freeway mainline
South of Brightman St:
• US6 (frontage roads) & MA79 (freeway mainline) separate both directions.
• MA138 (mainline) & US6 (frontage) separate southbound.
• MA138 (frontage) & MA79 (mainline) separate northbound

Misc:
NY I-678: graph point near southern end
TX US287: Lampasas St interchange, Ennis
TXLp395: point at US60
remove nmpfpsunmatched
Title: Re: yakra's collaborator thread
Post by: yakra on August 24, 2019, 01:01:08 pm
Code: [Select]
bool Waypoint::has_exit_number()
{ // return whether this waypoint has a "standard" exit number for its own route:
// begins with numeral(s) and is followed by no more than one capital letter only
if (label[0] < '0' || label[0] > '9') return 0; // anything not starting with a numeral is out
size_t i = 1;
while (i < label.size() && label[i] >= '0' && label[i] <= '9') i++; // skip remaining numerals
if (i == label.size()) return 1; // reached the end after all numerals
if (i < label.size()-1) return 0; // >1 character after numerals
if (label[i] >= 'A' && label[i] <= 'Z') return 1; // last char is capital letter
return 0; // all remaining cases are out
}
Title: Re: yakra's collaborator thread
Post by: yakra on September 22, 2019, 08:59:32 pm
Operation Directional Prefix

Code: [Select]
Region Results Command
-----------------------------------------------------------------------------------------------------------------------------------
CT 34 grep -v '^NY/CT\|^CT/NY' CT/*/*.wpt | grep '[NEWS][A-Z]\|[NS][EW][A-Z]'
KS 12 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' KS/*/*.wpt | grep -v '[NS][EW][0-9]\|[NEWS]Rd'
MA 19 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' MA/*/*.wpt | grep -v NY/MA
ME 136 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' ME/*/*.wpt | grep -v NH/ME
NE 40 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' NE/*/*.wpt | grep -v 'NE[0-9]\+[A-Z]\?[ _/]\|NE/[A-Z][A-Z] \|[A-Z][A-Z]/NE '
NH 57 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' NH/*/*.wpt | grep -v 'NH[0-9]\|NH/[A-Z][A-Z] '
NJ 45 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' NJ/*/*.wpt | grep -v 'NJ[0-9]\|NJ/[A-Z][A-Z] \|[A-Z][A-Z]/NJ \|NJTpk '
NY 192 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' NY/*/*.wpt | grep -v 'NY[0-9]\|NY/[A-Z][A-Z] \|[A-Z][A-Z]/NY '
OK 8 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' OK/*/*.wpt | grep -v 'NM/OK'
RI 9 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' RI/*/*.wpt
TX 27 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' TX/*/*.wpt | grep -v 'NM/TX\|[WE]End\|NASA\|[0-9]\{4\} '
AB 2 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' AB/*/*.wpt | grep -v 'SK[0-9]\{1,3\} \|SK/AB \|NT/AB '
MB 19 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' MB/*/*.wpt | grep -v '[NS]./MB '
NB 30 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' NB/*/*.wpt | grep -v 'NB[0-9]\|N./[A-Z][A-Z] '
NS 44 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' NS/*/*.wpt | grep -v 'NS[0-9]\|NB/NS'
PE 2 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' PE/*/*.wpt | grep -v NB/PE
NL 2 grep '^[NEWS][A-Z]\|^[NS][EW][A-Z]' NL/*/*.wpt | grep -v 'NL[0-9]'
All-purpose Formula:
grep '^[NEWS]' $rg/*/*.wpt | cut -f1 -d' ' | egrep -v ":\+|:.[a-z]|:[A-Z]{2}/[A-Z]{2}$|$rg[0-9]{1,3}|^NE/.*:S[0-9]{1,2}[A-Z]$|:NJTpk|^OK/.*:[NEWS][0-9]{4}|:[NEWS]End$|:NASA"
AR   8
CT   27
KS   33
MA   17
ME   128
NE   34
NH   49
NJ   24
NY   133
OK   9
RI   8
TX   34 48?
AB   5
MB   19
NB   30 33?
NS   44
PE   2
NL   2 10?
Title: Re: yakra's collaborator thread
Post by: yakra on September 22, 2019, 11:30:36 pm
grep-o-roonie
inna USA/CAN stylee

1. Potential malformed city suffixes, including directional
grep '^[A-Z][A-Z][0-9]\{1,3\}[A-Z][a-z][a-z]_[NEWS]' */*/*.wpt | grep -v '[A-Z][A-Z][0-9]\{1,3\}Alt_[NEWS]\|[A-Z][A-Z][0-9]\{1,3\}Bus_[NEWS]\|[A-Z][A-Z][0-9]\{1,3\}Byp_[NEWS]\|[A-Z][A-Z][0-9]\{1,3\}Trk_[NEWS]\|[A-Z][A-Z][0-9]\{1,3\}His_[NEWS]\|[A-Z][A-Z][0-9]\{1,3\}Spr_[NEWS]\|[A-Z][A-Z][0-9]\{1,3\}Con_[NEWS]'

2. Potential malformed city suffixes, more complete list
grep '^[A-Z][A-Z][0-9]\{1,3\}[A-Z][a-z][a-z]' */*/*.wpt | grep -v '[A-Z][A-Z][0-9]\{1,3\}Alt\|[A-Z][A-Z][0-9]\{1,3\}Bus\|[A-Z][A-Z][0-9]\{1,3\}Byp\|[A-Z][A-Z][0-9]\{1,3\}Trk\|[A-Z][A-Z][0-9]\{1,3\}His\|[A-Z][A-Z][0-9]\{1,3\}Spr\|[A-Z][A-Z][0-9]\{1,3\}Con'

3. "Good Alabama"
grep _ AL/*/*.wpt | grep -v '_[NEWS] \|_[A-Za-z]\{4\}'
A few false positives.

4. "Bad Maine"
grep 'US[0-9]\{1,3\}Alt.\+ ' ME/*/*.wpt | grep -v 'US[0-9]\{1,3\}Alt_[NEWS] '

5. 4-character LONG_UNDERSCORE datacheck
grep -i '_[A-Z]\{3\}[abcdfghijklmopqrtuvxyz] ' */*/*.wpt
Ubuntu:grep '_...[A-DF-MO-RTUVXYZa-z] ' */*/*.wpt
Error results:for rg in `ls`; do grep -s '_...[A-DF-MO-RTUVXYZa-z] ' $rg/*/*.wpt; done
Error counts:for rg in `ls`; do echo -en "$rg\t"; grep -s '_...[A-DF-MO-RTUVXYZa-z] ' $rg/*/*.wpt | wc -l; done
Good results:for rg in `ls`; do grep -s '_...[NEWS] ' $rg/*/*.wpt; done
Good counts:for rg in `ls`; do echo -en "$rg\t"; grep -s '_...[NEWS] ' $rg/*/*.wpt | wc -l; done

6. Old highway designation labels that may have a current visible name
grep '^Old..[0-9]' */*/*.wpt
This one will have a lot of false positives.
Title: Re: yakra's collaborator thread
Post by: yakra on September 27, 2019, 03:21:53 am
Operation Good Labels
MyRegions='CT MA ME NH RI KS NE OK NJ NY TX AB MB NB NS PE NL'
NewEngland='CT MA ME NH RI'
CentralStates='KS NE OK'
Canada='AB MB NB NS PE NL'
MiscRegions='NJ NY TX'

Operation 4-Char Suffix (with NEWS)
CT(14) MA(6) ME(33) NH(12) RI(12)
for rg in $NewEngland; do grep '_.... ' $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep '_....$'; done

Are all city suffixes appropriate?
Excluding 4-char cases with directional "subfix", as those are covered above
CT(7) MA(13) ME(69) NH(24) RI(1)
NE(7) OK(17)
NJ(3) NY(51) TX(3)
AB(8) NB(4) NS(17)
grep -v '^+' $rg/*/*.wpt | cut -f1 -d' ' | egrep ':[A-Z]{2}[0-9]+.*_...$'
grep -v '^+' $rg/*/*.wpt | cut -f1 -d' ' | egrep ':[A-Z]{2}[0-9]+.*_...$' | sed -r 's~.*/(.*).wpt.*~\1~' | uniq | sed 's~.*~http://192.168.1.20/hb/showroute.php?r=&~' | xargs firefox

Operation 2-Char Suffix
Excludes 4-char cases with directional "subfix"; those are covered above
CT(1) KS(3) MA(1) ME(11) NB(2)
for rg in $MyRegions; do grep '_.. ' $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep -v ':+' | grep '_..$'; done

Operation Too Many Words
CT(5) MA(1) ME(4) NE(1) NH(5) NY(6) NB(16) NL(29)
for rg in $MyRegions; do grep -s '[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]*' $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep '[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]*'; done
Not sufficient to match all cases. Refine regex & redo.

FooBarBRd
CT(1) MA(2) ME(2) NH(12) (17)
KS(3) NE(7) OK(10) (20)
NJ(5) NY(83) TX(9) (97)
AB(3) NB(25) NS(6) PE(1)  NL(3) (38)
for rg in $MyRegions; do grep '[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]\?[A-Z]\+[a-z]*' $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep -v '[NPS]P$' | grep '[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]\?[A-Z]\+[a-z]*'; done
for rg in $MyRegions; do grep -s '[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]\?[A-Z]\+[a-z]*' $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep -v '[NPS]P$' | grep '[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]\?[A-Z]\+[a-z]\+'; done

FooBBazRd
CT(1) MA(1) ME(7) NH(1) (10)
NJ(2) NY(8) TX(1) (11)
OK(1) (1)
NB(6) NL(4) (10)
for rg in $MyRegions; do grep -s '[A-Z]\+[a-z]\+[A-Z]\+[a-z]\?[A-Z]\+[a-z]\+[A-Z]\+[a-z]*' $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep -v ':Mc[A-Z][A-Z]' | grep '[A-Z]\+[a-z]\+[A-Z]\+[a-z]\?[A-Z]\+[a-z]\+[A-Z]\+[a-z]*'; done

FBarBazRd
CT(3) MA(1) ME(2) NH(3) RI(1) (10)
NY(28) TX(2) (30)
NB(16) NS(2) PE(1) NL(1) (20)
NE(1) (unprocessed WPT deleted) (1)
for rg in $MyRegions; do grep -s '[A-Z]\+[a-z]\?[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]*' $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep '[A-Z]\+[a-z]\?[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]*'; done

"All of the Above" mammoth regex
for rg in `ls`; do grep -s . $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep -v '[NPS]P$\|:[A-Z]*[a-z]*Mc[A-Z][A-Z][a-z]*$\|:Mc[A-Z][A-Z]\+[a-z]*[A-Z][a-z]*$\|:[A-Z]*Mc[A-Z]\+[a-z]\?$' | grep '[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]*\|[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]\?[A-Z]\+[a-z]\+\|[A-Z]\+[a-z]\+[A-Z]\+[a-z]\?[A-Z]\+[a-z]\+[A-Z]\+[a-z]*\|[A-Z]\+[a-z]\?[A-Z]\+[a-z]\+[A-Z]\+[a-z]\+[A-Z]\+[a-z]*'; done

Operation _End
MA(2) ME(3) NE(1) NH(2) OK(1) RI(2) AB(1)
for rg in $MyRegions; do grep _End $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep _End; done

Operation Predir
This got its own post (http://forum.travelmapping.net/index.php?topic=62.msg15512#msg15512)

Operation Postdir
CT(6) ME(7) NH(5) (18)
KS(16) NE(1) (17)
NJ(3) NY(10) TX(6) (19)
MB(2) NB(9) NS(3) NL(5) (19)
for rg in $MyRegions; do grep '[NEWS]' $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep '[NEWS]$' | grep -v ':+\|_\|[0-9]\{1,3\}[NEWS]$\|:[A-Z][A-Z]/[A-Z][A-Z]$\|:CR[A-Z]$\|:Rd[A-Z]$\|:Ave[A-Z]$\|:I\-[0-9]\{1,3\}BS$'; done

Operation Long Words
ME(1) NL(1)
for rg in $MyRegions; do grep . $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep -v ':+' | grep ':.*[a-z]\{4\}'; done

Operation McPotrzebie
MA(1) ME(2)
AB(2)
NJ(6) NY(6) TX(4)
for rg in $MyRegions; do grep Mc[A-Z][a-z] $rg/*/*.wpt; done
for rg in $Canada; do grep Mac $rg/*/*.wpt; done

Tpke -> Tpk
CT(7) MA(1) NH(10) RI(1)
OK(2)
NJ(4) NY(19) TX(1)
for rg in $MyRegions; do grep -s Tpke $rg/*/*.wpt | sed -e 's/ /%/' -e 's/\(.\+\)%.\+/\1/' | grep 'Tpke'; done
Title: Re: yakra's collaborator thread
Post by: yakra on November 07, 2019, 01:56:46 pm
Saving a few browser tabs...

Window 1
https://github.com/TravelMapping/HighwayData/pull/3073

Window 2
https://github.com/TravelMapping/HighwayData/pulls/
https://github.com/TravelMapping/HighwayData/pull/3093

Window 3
https://github.com/TravelMapping/HighwayData/pull/3115
https://github.com/TravelMapping/HighwayData/pull/3115/files
GMSV (https://www.google.com/maps/@19.6675263,-99.1345383,3a,16.7y,123.41h,85.37t/data=!3m9!1e1!3m7!1sTyiaeeSnwMcjR9putu7YOw!2e0!7i13312!8i6656!9m2!1b1!2i40)
GMSV (https://www.google.com/maps/@19.6309648,-99.193474,3a,75y,85t/data=!3m6!1e1!3m4!1s8ZNEGpbQOF_sBqz2cgtUqQ!2e0!7i13312!8i6656) -> GMSV (https://www.google.com/maps/@19.6339984,-99.1938197,3a,19.2y,359.85h,99.93t/data=!3m9!1e1!3m7!1s16XEy4dh98cg4fdgFcSMkw!2e0!7i13312!8i6656!9m2!1b1!2i40)
GMSV (https://www.google.com/maps/@19.6138955,-99.2308264,3a,15.1y,84.51h,103.69t/data=!3m9!1e1!3m7!1sthTv-PFPLMc5urD91TEE8g!2e0!7i13312!8i6656!9m2!1b1!2i40)
wptedit:
AniPer http://www.openstreetmap.org/?lat=19.483130&lon=-99.029721
+X169273 http://www.openstreetmap.org/?lat=19.486867&lon=-99.027940
CTM14 http://www.openstreetmap.org/?lat=19.488021&lon=-99.017533
EMEX5D_Per http://www.openstreetmap.org/?lat=19.487826&lon=-99.015865

Window 4
http://forum.travelmapping.net/index.php?topic=3147
http://forum.travelmapping.net/index.php?topic=3165
http://forum.travelmapping.net/index.php?topic=3167
http://forum.travelmapping.net/index.php?topic=3175
http://forum.travelmapping.net/index.php?topic=3176.msg15305#msg15305
Title: Re: yakra's collaborator thread
Post by: yakra on November 20, 2019, 02:10:33 am
Ideas to reject. Or not.

abbrev_as_suffix
These can show up in graph labels. 31 examples in:
egrep -i '([A-Z]{3})_\1' waypointsimplification.log
egrep -i '([A-Z]{3})_\1' tm-master-simple.tmg
I may have some data to fix; there's stuff in my regions
30 cases of 3+ intersection + one Exit/Intersection out of 430031 collapsed vertices. May well be fixable on the waypoint simplification side.

datacheck-style pseudocode
Code: [Select]
if (underscore != string::npos)
  for (Waypoint *p : *(w->colocated))
  { if (p == w) continue;
if ( p->route->abbrev.size()
     && w->label.substr(underscore+1, p->route->abbrev.size()) == p->route->abbrev
     && w->label.substr(0, underscore) == p->route->name_no_abbrev()
   ) { datacheckerrors->add(&r, w->label, "", "", "ABBREV_AS_SUFFIX", p->route->abbrev);
break;
     }
  }
/*TODO: else for (Waypoint *p : *(w->colocated))
     { if (p == w) continue;
if (regex("[0-9]+[A-Za-z]{3}") in label)
if ( p->route->route ends with same [0-9]+ \
and not p.route.banner.startswith(same [A-Za-z]{3}) \
and not p.route.abbrev.startswith(same [A-Za-z]{3})
   ) { datacheckerrors->add(&r, w->label, "", "", "FALSE_ABBREV", "Lorem Ipsum");
break;
     }
     }//*/
      }
 Not really worth doing as a datacheck. A child route can intersect or overlap its parent midway, resulting in a city_suffix: see MA122@MA122A_Wor. These cases alone + desire to be consistent with otherwise-same-style labels + enough of a gray area in the manual = abbrev_as_suffix should be accepted as normal, albeit awkward for graph labels.
false_abbrev or unexpected_abbrev, OTOH... ;)


LABEL_SELFREF
yakra@BiggaTomato:~/TravelMapping/yakra/DataProcessing/siteupdate/cplusplus/logs$ diff waypointsimplification.old waypointsimplification.i5 | egrep '^< Straightforward concurrency'
< Straightforward concurrency: L3238Her@L3238&L3238Mar@L3238 -> L3238Her/L3238Mar@L3238
< Straightforward concurrency: B279@B279&B279Hol@B279 -> B279/B279Hol@B279
< Straightforward concurrency: A329@A329_E&A329Rea@A329_E -> A329/A329Rea@A329_E
yakra@BiggaTomato:~/TravelMapping/yakra/DataProcessing/siteupdate/cplusplus/logs$ egrep 'L3238Her@L3238&L3238Mar@L3238|B279@B279&B279Hol@B279|A329@A329_E&A329Rea@A329_E' waypointsimplification.i5
Straightforward intersection: L3238Her@L3238&L3238Mar@L3238 -> L3238/L3238
Straightforward intersection: B279@B279&B279Hol@B279 -> B279/B279
Straightforward intersection: A329@A329_E&A329Rea@A329_E -> A329_E/A329_E
[yakra@noreaster /home/terescoj/travelmapping/HighwayData]$ egrep -n 'L3238|B279|A329' datacheckfps.csv
4030:deuby.b279;B279;;;LABEL_SELFREF;
4031:deuby.b279hol;B279;;;LABEL_SELFREF;
4109:deuhe.l3238her;L3238;;;LABEL_SELFREF;
4110:deuhe.l3238mar;L3238;;;LABEL_SELFREF;
4425:eng.a0329;A329_E;;;LABEL_SELFREF;
4426:eng.a0329;A329_W;;;LABEL_SELFREF;
4427:eng.a0329rea;A329_E;;;LABEL_SELFREF;
4428:eng.a0329rea;A329_W;;;LABEL_SELFREF;
Should arguably have the abbrev included...


INTERSTATE_NO_HYPHEN (https://github.com/TravelMapping/DataProcessing/pull/350) (9)
for rg in AK AL AR AS AZ CA CO CT DC DE FL GA GU HI IA ID IL IN KS KY LA MA MD ME MI MN MO MP MS MT NC ND NE NH NJ NM NV NY OH OK OR PA PR RI SC SD TN TX UT VA VI VT WA WI WV WY; do egrep '^I[0-9]|ToI[0-9]' $rg/*/*.wpt; done

UNDERSCORE_NUMBER (40)
numeral immediately follows underscore
for rg in `ls | grep -v _`; do grep -sv '^+' $rg/*/*.wpt | cut -f1 -d' ' | grep ':.*_[0-9]'; done

CLOSED_OPEN_COLOC (25)
Not always a true error.
Check with the other datachecks while WPTs are read, and thus while colocation lists are being populated. Iterate thru earlier points in list, breaking when current point is reached.

$rg/Can, Can/$rg, Mex/$rg, $rg/Mex border labels in USA (10)
for rg in AK AL AR AS AZ CA CO CT DC DE FL GA GU HI IA ID IL IN KS KY LA MA MD ME MI MN MO MP MS MT NC ND NE NH NJ NM NV NY OH OK OR PA PR RI SC SD TN TX UT VA VI VT WA WI WV WY; do egrep -i "^$rg/Can|^Can/$rg|^Mex/$rg|^$rg/Mex" $rg/*/*.wpt; done

banner_before_number (41)
for rg in `ls | grep -v _`; do for banner in Bus Trk His Alt Byp BS Fut AltTrk Sce BusTrk AltBus AltByp Wye; do grep -sv "^+" $rg/*/*.wpt | cut -f1 -d' ' | egrep -i ":.*$banner[A-Z]{,2}-?[0-9]+"; done | sort; done
http://forum.travelmapping.net/index.php?topic=2601.msg15607#msg15607

Old routes with false abbrevs that should be after the underscore (44)
Be sure to eliminate all potential banners.
Work on excluding FPs, e.g. Old3RRd Old9FootRd Old41Hwy Old4Hwy_N OldNo9Hwy
Tie into LACKS_GENERIC routines?
for rg in `ls | grep -v _`; do grep -sv '^+' $rg/*/*.wpt | cut -f1 -d' ' | egrep -v 'Alt$|Alt_[NEWS]$|Bus$|Bus_[NEWS]$|Byp$|Byp_[NEWS]$|Spr$|Spr_[NEWS]$' | egrep -i ':.*Old.*[0-9]+[A-Z]{3}'; done

NAMED_SLASH (141)
https://forum.travelmapping.net/index.php?topic=3245.msg21076#msg21076

CR-42, FI-42, ME-42, US-42, etc. (203)
for rg in `ls | grep -v _`; do egrep -s '^[A-Z]{2}-' $rg/*/*.wpt; done

Quote from: Quotey McQuoteface
SLASH_LONG_PREFIX {stash} (245)
for rg in `ls | grep -v _`; do grep -sv '^+' $rg/*/*.wpt | cut -f1 -d' ' | egrep -v ':\*?[A-Za-z]+/[A-Za-z]+$' | egrep ':.*/[A-Za-z]{2,}[0-9]'; done

slashed designation, unless: (number, optionally following single letter) (338)
for rg in `ls | grep -v _`; do grep -sv '^+' $rg/*/*.wpt | cut -f1 -d' ' | egrep -iv ':.*/[A-Z]?[0-9]|:\*?[A-Z]+/[A-Z]+$' | egrep ':.*+/'; done
overlap with graph-based unexpected_slash?
Take a closer look at the differences between these two

UNIQUE_SLASH_SUFFIX (https://forum.travelmapping.net/index.php?topic=62.msg20713#msg20713) (445)
http://travelmapping.net/devel/manual/wayptlabels.php#avoidsuffix
http://travelmapping.net/devel/manual/wayptlabels.php#identicalmultiplex
https://travelmapping.net/devel/manual/wayptlabels.php#plexnosuffix

PARENS_LONG_PREFIX (611)
for rg in `ls | grep -v _`; do grep -sv '^+' $rg/*/*.wpt | cut -f1 -d' ' | grep -v '([A-Z]\?[0-9]' | grep '(..[0-9]'; done

only_1_intersecting
Points with a '/' in label colocated with only 1 (or 0?) other
Lots of FP potential. Borders! Don't flag when...
• points are in different regions?
• point is at beginning or end of route?

extraneous_suffix
either parenthetical (https://forum.travelmapping.net/index.php?topic=62.msg20712#msg20712) or underscored, when only one jct with route
this could be a little tricky

I-designation + unexpected letter, excluding common banners
egrep -sv '^\+|^\*?I\-[0-9]+B[LS]|^\*?I\-[0-9]+Fut|^\*?I\-[0-9]+Spr|^\*?I\-[0-9]+Trk|^\*?I\-35[EW]|^\*?I-69[CEW]' $rg/*/*.wpt | cut -f1 -d' ' | egrep 'I\-[0-9]+[A-Za-z]'; done
A couple "Con" examples, incl 2 in NJ

KS US50 I-35(222) vice I-35/435
further examples from this thread, or the grep thread

route names in CSVs that break label naming rules
E.G. too many words
E.G. mexsf.csv: AutUrbSurCue
Title: Re: yakra's collaborator thread
Post by: yakra on November 28, 2019, 02:56:10 pm
mysql> select distinct banner from routes left join systems on systems.systemName = routes.systemName where countryCode = 'USA';
+--------+
| banner |
+--------+
|        |
| Bus    |
| Trk    |
| His    |
| Alt    |
| Con    |
| Lp     |
| Byp    |
| Spr    |
| BL     |
| BS     |
| Fut    |
| AltTrk |
| Sce    |
| BusTrk |
| AltBus |
| AltByp |
| Wye    |
+--------+
18 rows in set (0.07 sec)
Title: Re: yakra's collaborator thread
Post by: yakra on March 10, 2020, 04:27:29 am
TX/usaib/tx.i040bsgle.wpt:OldUS66
TX/usatxf2/tx.fm0524.wpt:OldFM425
TX/usatxf2/tx.fm0546.wpt:OldFM546_W
TX/usatxf3/tx.fm1021.wpt:OldFM2366
TX/usatxf/tx.fm0078.wpt:OldTXLp539_E
TX/usatxf/tx.fm0078.wpt:OldTXLp539_W
TX/usatxf/tx.fm0105.wpt:OldHwy90
TX/usatxf/tx.fm0413.wpt:OldTX6_N
TX/usatxf/tx.fm0413.wpt:OldTX6_S
TX/usatxf/tx.fm0418.wpt:OldFM418
TX/usatxf/tx.fm0418.wpt:OldHwy418
TX/usatxf/tx.fm0482.wpt:OldUS81
TX/usatxl/tx.lp0121.wpt:OldFM594
TX/usatxl/tx.lp0223.wpt:OldHwy20_W
TX/usatxl/tx.lp0223.wpt:OldHwy20_E
TX/usatxr/tx.rm0473.wpt:OldNo9Hwy
TX/usatxr/tx.rm1431.wpt:OldRM1431_W
TX/usatxr/tx.rm1431.wpt:OldRM1431_E
TX/usatxs/tx.sp0186.wpt:OldHwy20
TX/usatxs/tx.sp0419.wpt:OldFM524_S
TX/usatxs/tx.sp0419.wpt:OldFM524_N
TX/usatx/tx.tx025.wpt:OldUS82
TX/usatx/tx.tx034.wpt:OldTX34
TX/usatx/tx.tx035.wpt:OldTXLp419
TX/usatx/tx.tx036.wpt:OldHwy36
TX/usatx/tx.tx066.wpt:OldFM3211
TX/usatx/tx.tx137.wpt:OldTX137
TX/usatx/tx.tx151.wpt:OldHwy90
TX/usatx/tx.tx154.wpt:OldTX154
TX/usatx/tx.tx163.wpt:OldTX163
TX/usatx/tx.tx290.wpt:OldUS290
TX/usatx/tx.tx359.wpt:OldTX359
TX/usausb/tx.us059busspl.wpt:OldHwy59
TX/usaush/tx.us066hisgle.wpt:OldUS66
TX/usaus/tx.us067.wpt:OldSpr310
TX/usaus/tx.us079.wpt:OldFM1460
TX/usaus/tx.us090.wpt:OldUS90
TX/usaus/tx.us175.wpt:OldUS175_S
TX/usaus/tx.us175.wpt:OldUS175_N
TX/usaus/tx.us181.wpt:OldUS181_B
TX/usaus/tx.us181.wpt:OldUS181_C
TX/usaib/tx.i035blalv.wpt:*OldUS67Bus
TX/usai/tx.i030.wpt:*OldI-30_W
TX/usai/tx.i030.wpt:*OldI-30_E
TX/usatxf2/tx.fm0546.wpt:*OldFM546_E
TX/usatxf5/tx.fm2087.wpt:*OldTXLp281
TX/usatxf/tx.fm0121.wpt:*OldFM121_A
TX/usatxf/tx.fm0121.wpt:*OldFM121_B
TX/usatxf/tx.fm0121.wpt:*OldFM121_C
TX/usatxf/tx.fm0121.wpt:*OldFM121_D
TX/usatxf/tx.fm0481.wpt:*OldFM481_W
TX/usatxf/tx.fm0481.wpt:*OldFM481_E
TX/usatxl/tx.lp0281.wpt:*OldTXLp281
TX/usatxs/tx.sp0334.wpt:*OldUS183
TX/usatx/tx.tx005.wpt:*OldTX5
TX/usatx/tx.tx043.wpt:*OldFM1794
TX/usatx/tx.tx114.wpt:*OldUS82
TX/usatx/tx.tx121.wpt:*OldTX5
TX/usatx/tx.tx188.wpt:*OldTX188_W
TX/usatx/tx.tx188.wpt:*OldTX188_E
TX/usatx/tx.tx195.wpt:*OldTX195
TX/usausb/tx.us067busalv.wpt:*OldUS67Bus_S
TX/usausb/tx.us067busalv.wpt:*OldUS67Bus_N
TX/usaus/tx.us082.wpt:*OldUS82
TX/usaus/tx.us082.wpt:*OldUS82_W
TX/usaus/tx.us082.wpt:*OldUS82_E
TX/usaus/tx.us181.wpt:*OldUS181_A
TX/usaus/tx.us181.wpt:*OldTX359
TX/usaus/tx.us277.wpt:*OldUS277_S
TX/usaus/tx.us277.wpt:*OldUS277_N
TX/usaus/tx.us377.wpt:*OldI-30_W
TX/usaus/tx.us377.wpt:*OldI-30_E
Title: Re: yakra's collaborator thread
Post by: yakra on November 02, 2020, 10:35:37 am
EXTRANEOUS_EXIT (853)
Find unique parenthetical suffixes combined with unique prefixes. There will be false positives.
count=0
for rg in $(ls | grep -v _); do
  for dummy in $(ls $rg/*/*.wpt | tr ' ' '%'); do
    file=$(echo $dummy | tr '%' ' ')
    Ls=$(grep -v '^+' "$file" | cut -f1 -d' ' | grep '(.*)' | cut -f1 -d'(' | sed 's~^\*~~' | sort | uniq)
    Rs=$(grep -v '^+' "$file" | cut -f1 -d' ' | grep '(.*)' | cut -f2 -d'(' | sed 's~)$~~'  | sort | uniq)
    for l in $Ls; do
      if [ $(grep -m 2 "^\*\?$l(" "$file" | wc -l) = '1' ]; then
        for r in $Rs; do
          if [ $(cut -f1 -d' ' "$file" | grep -m 2 "($r)" | wc -l) = '1' ]; then
            result=$(grep -H "^$l($r)" "$file")
            if [ $(echo $result | wc -w) -gt '0' ]; then
              count=$(echo $count+1 | bc)
              echo -en "$count\t"
              echo $result
            fi
          fi
        done
      fi
    done
  done
done | tee extraneous_suffix.log

Send Firefox to all routes in each region, centered at the waypoint in question
for rg in $(cat ~/tmregions); do echo -n $rg; cut -f2 extraneous_suffix.log | grep "^$rg/" | sed "s~^$rg/[a-z0-9]\+/\(.*\)\.wpt:.*\(lat=[-.0-9]*&lon=[-.0-9]*\)~https://travelmapping.net/hb/showroute.php?r=\1\&\2\&zoom=14~" | xargs firefox; read go; done

Exclude some false positives, but produce some false negatives too (https://forum.travelmapping.net/index.php?topic=4598.msg25474#msg25474) (661)
count=0
for rg in $(ls | grep -v _); do
   for dummy in $(ls $rg/*/*.wpt | tr ' ' '%'); do
     file=$(echo $dummy | tr '%' ' ')
     Ls=$(grep -v '^+' "$file" | cut -f1 -d' ' | grep '(.*)' | cut -f1 -d'(' | sed 's~^\*~~' | sort | uniq)
     Rs=$(grep -v '^+' "$file" | cut -f1 -d' ' | grep '(.*)' | cut -f2 -d'(' | sed 's~)$~~'  | sort | uniq)
     for l in $Ls; do
       if [ $(grep -c -m 2 "^\*\?$l[( _]" "$file") = '1' ]; then
         for r in $Rs; do
           if [ $(cut -f1 -d' ' "$file" | grep -c -m 2 "($r)") = '1' ]; then
             result=$(grep -H -C 1 "^$l($r)" "$file")
             if [ $(echo "$result" | sed "s~^$file.~~" | cut -f1 -d' ' | grep -c '(') = 1 ]; then
               count=$(echo $count+1 | bc)
               echo -en "$count\t"
               echo "$result" | grep "^$file:"
             fi
           fi
         done
       fi
     done
   done
 done | tee EXTRANEOUS_EXIT.log

Don't require unique parenthetical part; avoid EE(RR) results & some false negatives (https://forum.travelmapping.net/index.php?topic=4598.msg25493#msg25493) (560)
count=0
for rg in $(ls | grep -v _); do
  for dummy in $(ls $rg/*/*.wpt | tr ' ' '%'); do
    file=$(echo $dummy | tr '%' ' ')
    for l in $(egrep -v '^\+|^\*?[0-9]' "$file" | cut -f1 -d' ' | grep '(.*)' | cut -f1 -d'(' | sed 's~^\*~~' | sort | uniq); do
      if [ $(grep -c -m 2 "^\*\?$l[( _]" "$file") = '1' ]; then
        result=$(grep -H -C 1 "^\*\?$l[( _]" "$file")
        if [ $(echo "$result" | sed "s~^$file.~~" | cut -f1 -d' ' | grep -c '(') = 1 ]; then
          count=$(echo $count+1 | bc)
          echo -en "$count\t"
          echo "$result" | grep "^$file:"
        fi
      fi
    done
  done
done | tee EXTRANEOUS_EXIT.log
Title: Re: yakra's collaborator thread
Post by: yakra on November 02, 2020, 03:55:01 pm
UNIQUE_SLASH_SUFFIX (445)
http://travelmapping.net/devel/manual/wayptlabels.php#avoidsuffix
http://travelmapping.net/devel/manual/wayptlabels.php#identicalmultiplex
https://travelmapping.net/devel/manual/wayptlabels.php#plexnosuffix
count=0
for rg in $(ls | grep -v _); do
  for dummy in $(ls $rg/*/*.wpt | tr ' ' '%'); do
    file=$(echo $dummy | tr '%' ' ')
    Ls=$(grep -v '^+' "$file" | cut -f1 -d' ' | grep '/.*_' | cut -f1 -d_ | sed 's~^\*~~' | sort | uniq)
    for l in $Ls; do
      if [ $(grep -m 2 "^\*\?$l" "$file" | wc -l) = '1' ]; then
        count=$(echo $count+1 | bc)
        echo -en "$count\t"
        grep -H "^\*\?$l" "$file"
      fi
    done
  done
done | tee UNIQUE_SLASH_SUFFIX.log

Send Firefox to all routes in each region, centered at the waypoint in question
for rg in $(cat ~/tmregions); do echo -n $rg; cut -f2 UNIQUE_SLASH_SUFFIX.log | grep "^$rg/" | sed "s~^$rg/[a-z0-9]\+/\(.*\)\.wpt:.*\(lat=[-.0-9]*&lon=[-.0-9]*\)~https://travelmapping.net/hb/showroute.php?r=\1\&\2\&zoom=14~" | xargs firefox; read go; done
Title: Re: yakra's collaborator thread
Post by: yakra on November 22, 2020, 01:46:51 am
Operation Spur

C++: Compile root pairs
Code: [Select]
std::unordered_map<std::string, std::list<Route*>> RteBan;

for (auto h : highway_systems)
  for (auto &r : h->route_list)
    RteBan[r.region->code+r.route+r.banner].push_back(&r);

for (auto &RteList : RteBan)
  if (RteList.second.size() > 1)
    for (Route* r : RteList.second)
      for (Waypoint *w : r->point_list)
if (w->colocated)
  for (Waypoint *p : *w->colocated)
    if (w < p && w->route != p->route && \
w->route->region->code + w->route->route + w->route->banner == \
p->route->region->code + p->route->route + p->route->banner)
      std::cout << "RESULT:\t" << w->route->root << '\t' << p->route->root << std::endl;
return 0;
label search (https://forum.travelmapping.net/index.php?topic=3926.msg20953#msg20953)
   std::unordered_map<std::string, std::list<Route*>> RteBan;

   for (auto h : highway_systems)
     for (auto &r : h->route_list)
       RteBan[r.region->code+r.route+r.banner].push_back(&r);

   for (auto &RteList : RteBan)
     if (RteList.second.size() > 1)
       for (Route* r : RteList.second)
         for (Waypoint *w : r->point_list)
      if (w->colocated)
      { std::string wrb = w->route->route + w->route->banner;
        for (Waypoint *p : *w->colocated)
        { std::string prb = p->route->route + p->route->banner;
          if (w != p && w->route != p->route && w->route->region->code + wrb == p->route->region->code + prb)
          {   if (w->route->abbrev.size() && w->label.substr(0,prb.size()) != prb)
           std::cout << "RESULT:" << w->route->region->code << '/' << w->route->system->systemname << '/' << w->route->root << ".wpt\t" << w->label << std::endl;
          }
        }
      }
   return 0;

Sh: Unique root list
t=`echo -en '\t'`
results=`grep '^RESULT' Spr/logs/siteupdate.log | sed "s~^RESULT:$t~~" | tr '\t' '\n' | sort | uniq`
echo $results | wc -w
1940

Sh: Look up in system CSVs
cd ~/TravelMapping/HighwayData/
systems=`tail -n +2 systems.csv | grep -v '^#' | cut -f1 -d';' | sed 's~.*~&.csv~'`
cd hwy_data/_systems
for r in $results; do grep ";$r;" $systems; done | wc -l
1940

cd ~/TravelMapping/HighwayData/hwy_data/_systems
n_abbrev=`for r in $results; do egrep ".*;.*;.*;.*;;.*;$r;.*" $systems | cut -f7 -d';'; done`
710
y_abbrev=`for r in $results; do egrep ".*;.*;.*;.*;.+;.*;$r;.*" $systems | cut -f7 -d';'; done`
1230
bad=`for r in $results; do egrep ".*;.*;.*;.*;.+;.*;$r;.*" $systems; done | grep '(spur)\|(loop)\|(branch)' | cut -f7 -d';'`
204
good=`for r in $results; do egrep ".*;.*;.*;.*;.+;.*;$r;.*" $systems; done | grep -v '(spur)\|(loop)\|(branch)' | cut -f7 -d';'`
1026

Sh: How many regions?
echo $good | tr ' ' '\n' | cut -f1 -d. | uniq | wc -l
112 (9.2 rtes/rg)
echo $bad | tr ' ' '\n' | cut -f1 -d. | uniq | wc -l
41 (5 rtes/rg)

for rg in `echo $good | tr ' ' '\n' | cut -f1 -d. | uniq`; do echo -n "$rg "; echo $good |tr ' ' '\n' | grep "^$rg" | sed 's~.*~https://travelmapping.net/hb/showroute.php?r=&~' | xargs firefox; read go; done; echo

To be continued...
Title: Re: yakra's collaborator thread
Post by: yakra on November 05, 2021, 04:15:23 pm
Toward reducing the number of LABEL_SELFREF false positives


LABEL_SELFREF 1 (https://github.com/TravelMapping/DataProcessing/blob/0d2aee9e3ba3f07678d5175f139cecf72f4b2ac5/siteupdate/cplusplus/classes/Waypoint/Waypoint.cpp#L440) (match after /)
az.az095;I-10BL/95;;;LABEL_SELFREF1;
de.de202;I-95/202;;;LABEL_SELFREF1;
deuhe.l3308;St2305/3308;;;LABEL_SELFREF1;
fin.e8;Vt4/8;;;LABEL_SELFREF1;
tx.tx070;US62/70;;;LABEL_SELFREF1;
FP because: Digits after slash are a different designation type (https://github.com/TravelMapping/DataProcessing/issues/475). Route included in the HB.

al.al106;CR1/106;;;LABEL_SELFREF1;
fl.fl276;CR167/276;;;LABEL_SELFREF1;
...and West Virginia LOL
FP because: Digits after slash are a different designation type: not AL106 but CR106 which is not and will not be in HB. Must be manually marked FP. Consider this the canonical FP example. :)

al.us072altdec;US43/72;;;LABEL_SELFREF1;
eng.a1077m;A18/A1077;;;LABEL_SELFREF1;
nj.us009trkjer;US1/9;;;LABEL_SELFREF1;
etc. ...
FP because: Testing a bannered route. Require banner match at unbannered parent route.


LABEL_SELFREF 2 (https://github.com/TravelMapping/DataProcessing/blob/0d2aee9e3ba3f07678d5175f139cecf72f4b2ac5/siteupdate/cplusplus/classes/Waypoint/Waypoint.cpp#L447) (match between / and _)
{ Folded into LABEL_SELFREF 1 (https://github.com/yakra/DataProcessing/issues/197#issuecomment-968334485) }
ga.ga023;US1/23_N;;;LABEL_SELFREF2;
ga.ga023;US1/23_S;;;LABEL_SELFREF2;
FP because: Digits after slash are a different designation type: US23 not GA23.

sd.us385trkhil;US16/385_N;;;LABEL_SELFREF2;
sd.us385trkhil;US16/385_S;;;LABEL_SELFREF2;
va.us019trkbri;US11E/19_S;;;LABEL_SELFREF2;
FP because: Testing a bannered route. Require banner match at unbannered parent route.


LABEL_SELFREF 3 (https://github.com/TravelMapping/DataProcessing/blob/0d2aee9e3ba3f07678d5175f139cecf72f4b2ac5/siteupdate/cplusplus/classes/Waypoint/Waypoint.cpp#L458) (match entire string)
ita.a001sas;A1;;;LABEL_SELFREF3;
ita.a013pad;A13;;;LABEL_SELFREF3;
Flagged because: Graph connection not present.
The rest all look like genuine errors.
Don't separate out slash matches via a switch -- even with banner_after_slash, coloc_same_designation is still necessary.


LABEL_SELFREF 3 (https://github.com/TravelMapping/DataProcessing/blob/0d2aee9e3ba3f07678d5175f139cecf72f4b2ac5/siteupdate/cplusplus/classes/Waypoint/Waypoint.cpp#L458) (match before /)
ga.ga011;GA11/135Byp_S;;;LABEL_SELFREF3;
ga.us001;US1/23Bus_N;;;LABEL_SELFREF3;
etc. ...
FP because: Banner of intersecting route is included after slash in label. (https://github.com/TravelMapping/DataProcessing/issues/420)

nj.us001;US1/9Trk;;;LABEL_SELFREF1;
FP because: No graph connection with bannered route. Must be manually marked FP. Consider this the canonical "/Ban" FP?

tn.us079 (https://travelmapping.net/hb/showroute.php?r=tn.us079&lat=35.813924&lon=-88.933554&zoom=17);US79/70AltByp;;;LABEL_SELFREF3;
Watch out for what happens with this one. Intersects US79BypHum & US70AltBypHum.
Wait, this makes sense as (US79/70Alt)(Byp). It's FP, and not flagged. Good to go.

indwb.nh027;NH27/517;;;LABEL_SELFREF3;
indwb.nh114;NH114/WB14_E;;;LABEL_SELFREF3;
indwb.nh114;NH114/WB14_W;;;LABEL_SELFREF3;
indwb.nh312;NH312/WB3;;;LABEL_SELFREF3;
jpn.n011;N11/N193;;;LABEL_SELFREF3;
True positives.


LABEL_SELFREF 4 (https://github.com/TravelMapping/DataProcessing/blob/0d2aee9e3ba3f07678d5175f139cecf72f4b2ac5/siteupdate/cplusplus/classes/Waypoint/Waypoint.cpp#L461) (match before _)
srb.e75bel;E75_N;;;LABEL_SELFREF4;
mexgro.mex200vie;MEX200_Pan;;;LABEL_SELFREF4;
jpn.n193kag;N193_S;;;LABEL_SELFREF4;
Flagged because: Graph connection not present.
The rest all look like genuine errors.
Nothing to do here.


Inspect stuff in the HB

lines=$(diff $v1/logs/datacheck.log $v2/logs/datacheck.log | grep '^>' | cut -f2 -d' ' | tail -n +2) #new errors
lines=$(diff $v1/logs/unmatchedfps.log $v2/logs/unmatchedfps.log | grep '^>' | cut -f2 -d' ' | tail -n +2)  #removed FPs
lines=$(grep -vF -f <(grep LABEL_SELFREF _obj/logs/unmatchedfps.log) ~/tm/HighwayData/datacheckfps.csv | grep LABEL_SELFREF) #remaining FPs

for line in $lines; do
  r=`echo $line | cut -f1 -d';'`
  l=`echo $line | cut -f2 -d';'`
  grep "^$l " ~/tm/HighwayData/hwy_data/*/*/$r.wpt \
  | sed -r "s~.+(lat=.+)~https://travelmapping.net/hb/showroute.php?r=$r\&\1\&zoom=17~"
done | xargs firefox

An unrelated exercise for the reader ;)
grep -hF -f <(tail -n +2 $(ls | grep -v _) | egrep '.*;.*;.*;[^\-].*;;.*;.*;.*' | sed -r 's~(.*;.*;.*;[^\-].*;);.*;.*;.*~\1~') $(ls | grep -v _) | sed -r "s~(.*;.*;.*;.*;)(.*)(;.*;.*;.*)~\1$e[1;31m\2$e[0m\3~" | less -r

strd.o
Postslash exception for "Old"?
• *OldUS93/95 (https://travelmapping.net/hb/showroute.php?r=nv.us095&lat=35.985420&lon=-114.921311&zoom=17)
• OldSD20/63_N (https://travelmapping.net/hb/showroute.php?r=sd.sd063&lat=45.443618&lon=-101.060958&zoom=17)
• OldSD20/63_S (https://travelmapping.net/hb/showroute.php?r=sd.sd063&lat=45.431753&lon=-101.079926&zoom=17)
• *OldWI35/64 (https://travelmapping.net/hb/showroute.php?r=wi.wi064&lat=45.07189&lon=-92.77485&zoom=17)
Title: Re: yakra's collaborator thread
Post by: yakra on November 20, 2021, 01:09:11 am
speed micro-comparison: what if breaks were returns? Faster / margin of error
case '_': break if FP; mark it once. This will facilitate further experimentation. Speed? Marginally faster.
banner_after_slash FIXME: call strdstr with slash, not slash+1 <--It'll be grand. There's needs to be something (e.g. numerals) between slash & banner anyway.
banner_after_slash speed: FRA dept banners?
banner_after_slash: whitespace @ right parens
Meta-exceptions: put some cases back in
Code: [Select]
switch(*c)
{   case 0: if (route->abbrev.empty() || !coloc_same_designation(rte))
  Datacheck::add(route, label, "", "", "LABEL_SELFREF", "");
break;
    case '_': { if (*++c == 'U')
{ while (isdigit(*++c));
if (!*c) break;
}
Waypoint* w = coloc_same_designation(rte);
if (!w || (route->banner.empty() || route->banner[0] == '-') && w->route->abbrev.size())
Datacheck::add(route, label, "", "", "LABEL_SELFREF", "");
      } break;
_ua: if (!w || w->route->abbrev.size())
Title: Re: yakra's collaborator thread
Post by: yakra on November 20, 2021, 01:06:49 pm
e1c106c4cb26c6579df2e2b607fd09382454112d
categorize everything again; get wicked specific
Code: [Select]
#define XINFO(w)\
     std::string(route->banner.empty() ? ":" : (route->banner[0]=='-' ? "-" : "B")) + \
(route->abbrev.empty() ? ":" : "A") + \
(w ? std::string(w->route->banner.empty() ? ":" : (route->banner[0]=='-' ? "-" : "B")) + \
(w->route->abbrev.empty() ? ":" : "A") : "!")
Qty  Subtype                | TODO description/comments
6    LABEL_SELFREF/1::::    | TOSS same number different prefix
1    LABEL_SELFREF/1:::A    | TOSS same number different prefix
7    LABEL_SELFREF/1::!     | KEEP 6 FP CR; 1 true error
1    LABEL_SELFREF/1:A!     | KEEP FP CR
1    LABEL_SELFREF/D-A-:    | TOSS "bannered routes and the suffixed equivalents" vs #parentonly
1    LABEL_SELFREF/D::::    | TOSS self-intersection
1    LABEL_SELFREF/D:::A    | TOSS https://travelmapping.net/devel/manual/wayptlabels.php#slash
3    LABEL_SELFREF/D::!     | KEEP true errors
8    LABEL_SELFREF/D:A::    | TOSS "bannered routes and the suffixed equivalents" (6 #parentonly, 2 #parentplussuffixes)
2    LABEL_SELFREF00-:-:    | TOSS same designation different system, comparable to NH16 in ME intersecting ME16
41   LABEL_SELFREF00-:!     | KEEP true errors (new FRA (https://github.com/TravelMapping/DataProcessing/issues/318))
25   LABEL_SELFREF00-A-:    | TOSS child intersecting parent
2    LABEL_SELFREF00-A!     | KEEP true errors (new FRA (https://github.com/TravelMapping/DataProcessing/issues/318))
10   LABEL_SELFREF00::::    | KEEP self-intersection (>1 intersection = should have underscore or slash)
1    LABEL_SELFREF00:::A    | KEEP #abbrev (https://travelmapping.net/devel/manual/wayptlabels.php#abbrev)
18   LABEL_SELFREF00::!     | KEEP 17 true errors, 1 FP (RUS)
718  LABEL_SELFREF00:A::    | TOSS child intersecting parent
74   LABEL_SELFREF00:A:A    | KEEP #abbrev (https://travelmapping.net/devel/manual/wayptlabels.php#abbrev)
3    LABEL_SELFREF00:A!     | KEEP 1 true, 1 FP, 1 could be fixed by syncing coords
1    LABEL_SELFREF00BA!     | KEEP true error (MS315SceSar @ MS315Sce)
1    LABEL_SELFREF00BAB:    | TOSS child intersecting parent (eng.a0627msla)
2    LABEL_SELFREF00BABA    | KEEP #abbrev (https://travelmapping.net/devel/manual/wayptlabels.php#abbrev)
22   LABEL_SELFREF__-:-:    | TOSS self-intersection
21   LABEL_SELFREF__-:!     | KEEP true errors (new FRA (https://github.com/TravelMapping/DataProcessing/issues/318))
2    LABEL_SELFREF__-A-:    | TOSS child intersecting parent
1    LABEL_SELFREF__-A!     | KEEP true error (new FRA (https://github.com/TravelMapping/DataProcessing/issues/318))
89   LABEL_SELFREF__::::    | TOSS self-intersection
7    LABEL_SELFREF__:::A    | KEEP #abbrev (https://travelmapping.net/devel/manual/wayptlabels.php#abbrev)
31   LABEL_SELFREF__::!     | KEEP 9 "_U[0-9]+[NEWS]", 4 local rds, 18 true errors (2 AL, 4 AUS, 7 IND, 2 ISR, 2 MS, 1 RUS)
294  LABEL_SELFREF__:A::    | TOSS child intersecting parent
34   LABEL_SELFREF__:A:A    | KEEP #abbrev (https://travelmapping.net/devel/manual/wayptlabels.php#abbrev) 11 piecemeal (2 DEU, 6 MEX, 3 TUR), 2 self-branch (NOR), 21 branches (6 IRL, 13 MEX, 2 OR)
2    LABEL_SELFREF__:A!     | KEEP 1 FP, 1 could be fixed by syncing coords
29   LABEL_SELFREF__BABA    | KEEP #abbrev (https://travelmapping.net/devel/manual/wayptlabels.php#abbrev) 28 US66His cases + PA420AltTrkRid @ PA420AltTrk_Pro
1    LABEL_SELFREF//-:::    | TOSS same designation different system, comparable to DE202 vs US202
16   LABEL_SELFREF//-:!     | KEEP true errors (new FRA (https://github.com/TravelMapping/DataProcessing/issues/318))
2    LABEL_SELFREF//::::    | TOSS self-intersection
1    LABEL_SELFREF//:::A    | TOSS https://travelmapping.net/devel/manual/wayptlabels.php#slash
10   LABEL_SELFREF//::!     | KEEP 1 BAS, 4 local rds, 4 true errors (1 missing banner)
48   LABEL_SELFREF//::!S    | TOSS banner_after_slash
10   LABEL_SELFREF//:A::    | TOSS "bannered routes and the suffixed equivalents" (9 #parentonly, 1 that connects 2x, but only @1 end)
1    LABEL_SELFREF//:A:A    | TOSS "bannered routes and the suffixed equivalents" vs #parentplussuffixes
2    LABEL_SELFREF++:A:A:A! | TOSS self-intersection
3    LABEL_SELFREF++:A!:A!  | KEEP true errors
1    LABEL_SELFREF++:A!:ABA | TOSS coloc_banner_matches_abbrev()
2    LABEL_SELFREF++BA!BA!  | KEEP true errors
1556 Total

Is every banger a keeper? No, just the obvious ones -- banner_after_slash is an exclusion. In ++ cases, ! represents 2 different variables; FP possible with just 1.
Is every keeper a banger? Yes, so far, those explicitly listed at least. No.
Double-check tossers.
Review self-intersections. 00 not tossers, right? Any others?
Should self-intersection detection be combined into coloc_same_designation? Nah. Any occurrences other than those explicitly listed above? Just one. (http://192.168.1.20/hb/showroute.php?r=irl.wawbas&lat=51.821376&lon=-10.274835&zoom=18)
coloc_same_designation should always return a vanilla route if there is one: '@' sorts before letters, and no routes have abbrevs starting with numerals. If any exist in the future, this should be rare enough to not bother with.

Potential underscore_abbrev(const char*) candidates
dnk.mr;MR_Gly;;;LABEL_SELFREF__:::A;
or.or223;OR223_Dal;;;LABEL_SELFREF__:::A;
or.or223dal;OR223_Ric;;;LABEL_SELFREF__:A:A;
or.or223ric;OR223_Dal;;;LABEL_SELFREF__:A:A;
pa.pa420alttrkrid;PA420AltTrk_Pro;;;LABEL_SELFREF__BABA;
Title: Re: yakra's collaborator thread
Post by: yakra on December 02, 2021, 02:41:02 pm
.:.:   (is(00) && returned_route == route) ? KEEP : TOSS
.:.A   KEEP except slashes
.A.:   TOSS
.A.A   KEEP except slashes


1556 total
- 3 "++"-flavored = 1553
- 63 "//"-flavored = 1490
- 18 "/1" & "/D" flavored = 1472
- 407 "__"-flavored = 1065
- 746 "00"-flavored = 319


_sa0 -> _uu:
+ 70 errors = 7 :::A + 34 :A:A + 29 BABA

_uu -> _00:
+ 87 errors = 10 :::: + 1 :::A + 74 :A:A + 2 BABA
Title: Re: yakra's collaborator thread
Post by: yakra on February 20, 2022, 12:03:30 pm
Q: Why the extra {}s in the switch block again?
A: Otherwise, cannot jump from switch statement to later case labels bypassing variable initialization

Types of new helper functions:
   Route* coloc_same_number(const char*);
   Route* coloc_same_designation(const std::string&);
   Route* self_intersection();
   bool banner_after_slash(const char*);
   Route* coloc_banner_matches_abbrev();

To modify datacheckfps.csv
Code: [Select]
./s1.sh -v -e -y
echo "$(sed $(grep LABEL_SELFREF logs/nearmatchfps.log | tr '\n' '~' | sed -e 's/FP_ENTRY: /\n-e s~/g' -e 's~CHANGETO: ~~g') ~/tm/HighwayData/datacheckfps.csv)" > ~/ytm/HighwayData/datacheckfps.csv
./s1.sh -v -e -y
echo "$(grep -vF -f <(grep LABEL_SELFREF logs/unmatchedfps.log) ~/ytm/HighwayData/datacheckfps.csv)" > ~/ytm/HighwayData/datacheckfps.csv

In case I ever wanna refer to this again
Code: [Select]
#define XINFO(r)     std::string(route->banner.empty() ? ":" : (route->banner[0]=='-' ? "-" : "B")) + \
(route->abbrev.empty() ? ":" : "A") + \
(r ? std::string(r->banner.empty() ? ":" : (route->banner[0]=='-' ? "-" : "B")) + \
(r->abbrev.empty() ? ":" : "A") : "!")
Title: Re: itass: Italy Strade Statali
Post by: yakra on October 17, 2024, 01:47:51 pm
Code: [Select]
15: splitregion: unknown error for michih in line ITA SS685 SS3 SP64
16: splitregion: unknown error for michih in line ITA SS685 SP129 SS4
17: splitregion: unknown error for michih in line ITA SS685 SP129 SS4
18: splitregion: DISCONNECTED_ROUTE in italig.e74 itapie.e74 for michih in line ITA E74 A21 FRA/ITA
Unknown? I want to know!

Edit: ITA route goes east-to west.
Split-region ConRoute goes west-to-east.
All the more reason to not try to automatically generate new .list lines (the way it's been done till now at least) and let hidden systems work their magic instead.
Title: Re: yakra's collaborator thread
Post by: si404 on October 18, 2024, 04:54:26 am
That disconnected route error is because there's a disconnection (the route dips into France) that shouldn't be connected. The split E74 files would have been made without editing the text (just copy-and-rename), so I have no clue how they would have changed direction.

And they haven't - they are all west to east.

Anyway, disconnected now.
Title: Re: yakra's collaborator thread
Post by: yakra on October 18, 2024, 08:47:03 am
The reverse-direction thing was the "unknown error", just SS685.
Only E74 had the disconnection.
Title: Re: yakra's collaborator thread
Post by: yakra on October 19, 2024, 08:57:29 pm
yakra@BiggaTomato:~/ytm/HighwayData$ 2>/dev/null find . -name \* | grep -v '^\./\.' | while read item; do cat "$item"; done | wc -c
287759629
yakra@BiggaTomato:~/ytm/HighwayData$ echo 'scale=2; 287759629/1048576' | bc
274.42
yakra@BiggaTomato:~/ytm/HighwayData$ 2>/dev/null find . -name \* | while read item; do cat "$item"; done | wc -c
648718644
yakra@BiggaTomato:~/ytm/HighwayData$ echo 'scale=2; 648718644/1048576' | bc
618.66