TX: TxDOT Highway Designations changes (shapefiles)

[yakra]

http://gis-txdot.opendata.arcgis.com/datasets/txdot-highway-designations

The Transportation Planning and Programming (TPP) Division of the Texas Department of Transportation (TxDOT) created and maintains this dataset as a repository for all highway designation changes approved by the Texas Transportation Commission (the Commission), as documented in the "Minute Orders."  This dataset includes additions and updates to, and removals from, the state highway system as approved by the Commission. Update Frequency: As needed (several times a year)
Security Level: Public

[yakra]

TxDOT Future Texas Toll Roads

This dataset contains all future, planned, proposed, and under-construction tolls as of the end of 2017 for on-system (state owned) and off-system (privately owned) tollways in Texas. Future toll facilities are tracked for the purpose of TxDOT and the public to be aware of where new tolls are being built. Toll data is acquired by TxDOT from the various toll operators and contractors throughout the state.

[yakra]

Waiting for OSM to catch up to my edits:
http://www.dot.state.tx.us/tpp/hwy/sh/sh0015.htm

TXLp345:
Still signed, as Loop not Spur. Shapefiles agree with map from minute order, and some text. Minute order text inconsistent with itself. The "IT IS THEREFORE ORDERED" bit agrees with designation file, Statewide Planning Map, and grid maps. And the HB. Notwithstanding the fact that it's still signed...
https://www.aaroads.com/forum/index.php?topic=16777.msg2104176#msg2104176

TXLp238 -> US271BusPit

Potential new routes:
http://www.dot.state.tx.us/tpp/hwy/sh/sh0032.htm proposed/planned, no construction
http://www.dot.state.tx.us/tpp/hwy/ss/ss0425.htm unsigned

[yakra]

Checked items with an APRV_YR of 2013 or later.
If these files are in fact updated several times a year, they may be a useful tool for staying on top of future revisions.

[yakra]

2020-08-19
1057 total records
https://github.com/TravelMapping/HighwayData/pull/4186

ToDo
TX16/FM1560 olap
TX289BusPro deleted
TX207/FM146 jct (edit OSM)
FM437Spr N of Rogers

No MO_NBR; APRV_YR is ****
wait for signage

[yakra]

2021-04-28
1070 total records

ID      DSPN_DSCR
1058    Designate SH 34 on New Location
1059    Extend and realign designation of FM 897
1060    Extend designation of FM 2499 along Barrel Strap Ln and State School Rd
1061    Designate Segment of FM 1460 on New Location
1062    Designate as FS 1460
        Old1460Trl signage, but no FS 1460
1063    Obliterate this Segment of FM 1460
1064    Obliterate this Segment of FM 1460
1065    Add Segment of BU 287-P to State Highway System
        https://www.google.com/maps/dir/32.7314025,-97.2986101/32.731583,-97.3031484
1066    Remove Segment of BU 287-P from State Highway System
        TX US287BusFtW RosSt_E I-35W(49B)
        Concurrent with parent, or split into 2 segments? Odd that this'd have 1 single letter designation, unlike San Angelo
1067    Designate SS 320 on New Location
        Borderland Expy
1068    Redisgnate Segment of SH 34 as BS 34-G
1069    Redesignate Segment of US 59 as US [sic; should be BU] 59-C
        WTF? This is already BU 59-D AKA US59BusCar
1070    Remove Segment of FM 1388 from State Highway System

[yakra]

2021-08-13
1077 total records

ID      DSPN_DSCR
1071    Redesignate Segment of US 77 as I-69E
1072    Extend FM 509
        N to FM1599
1073    Redesignate Segment of US 59 as BU 59-C
        Marshall, near FM2625 to Henderson School House Rd N of FM1793
1074    Designate Segment of US 59 on New Location
        TXLp390 @ PopSt to US59 @ Henderson School House Rd
1075    Designate US 59 Concurrent with SL 390
        TX TXLp390 PopSt US80_E
1076    Designate Segment of US 59 on New Location
        near FM2625 to US80
1067    Extend SL 390 on New Location Concurrent with US 59
        to I-20 as per designation file

[yakra]

Older records

for r in {0..99}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {100..199}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {200..299}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {300..399}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {400..461}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {462..499}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {500..599}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {600..699}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done #635
for r in {700..799}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {800..899}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {900..999}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done
for r in {1000..1056}; do clear; ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf $r; read OK; done

ID      DSPN_DSCR / comments
101     Connection to Starr-Camargo International Bridge
        Unconstructed, || to Redwood St
103     Extend FM 65 designation along SH 85
104     Extend FM 65 designation along SH 85
        I wanna see more consistent signage before implementing this. (OTOH, take another look E of San Marcos)
105     Extend designation of FM 528
        to TX6 W of Alvin, unconstructed
112     Redesignate FM 1419 as FM 3550
113     Redesignate FM 1419 as FM 3551
114     Designate new location of SH 32
115     Redesignate FM 1419 as SH 32
188     Extended from IH0030 southward to US0082
        FM2878, no bridge, not signed, not FM per shapefiles
409     Redesignate as SH 310
        Yes, there it is, the N extension via old US175! Wait for signage to catch up.
434     Extend designation of FM 1409
        November 2021. Extension N of I-10; new segment S of I-10. Bridge connecting them = when?
450     Extend to the proposed Border Safety Inspection Facility
        Unsigned; facility not constructed
456     Transferred to City of San Antonio
        FM1560. Still signed May 2022; construction underway
        MO 114167 rescinded by MO 116306
475     Redesignate as BS 6P
        Reagan. May 2023 GMSV, still signed as if TX6 proper.
480     Transferred to City of Haslet
        Looks erroneous -- is current signed alignment; Schoolhouse Rd probably intended.
603     Designated SS 300
        Unbuilt. Potential ROW concerns, but possibly a moot point now that I-69 is being built.
607     Redesignated FM 61
        Bad description. It's really TX251 redesignated as FM926. Minute Order also redesignated part of TX251 as FM61, but that part of the arc is missing from the file. Hence the confusion.
979     Designate FM 157 Concurrent with US 287
        Wait for signage to catch up... or do an implied concurrency? Review designation file.
1004    Remove segment of FM0127 from state highway system, from SH49 south to US271, approx 1.6 miles
        TX FM127 US271 TX49

[yakra]

2022-02-07
1077 total records, but ordered differently. Gotta unpack this...

ISTR shapefile record numbering starts at 1.
But my "DBFquery" tool starts at 0 (oops), so using that nomenclature here.

Record number vs OBJECTID gets out of sync by 1.
OBJECTID 918 is missing from new file.
With match offset by 1 in that part of the file (see table below), that corresponds to OBJECTID 919 in the old file.
Because my array numbering starts @ 0, we're back to record "918", the missing apocryphal "SS 345". BAM!
Before this point in each file is "Proposed designation of SL195 along a new location from US 83 at Loma Blanca Rd to FM 755".

Do earlier revisions differ similarly? Check using script.
2021-04-28 <-> 2021-08-13: OBJECTID 1058 & 1068 have missing MO_NBR, APRV_DT, APRV_YR & STATE fields filled.
2020-08-19 <-> 2021-04-28 has diffs.
2020-04-28 <-> 2020-08-19: FID field renamed OBJECTID.
2019-03-26 <-> 2020-04-28: Data formatting changed too much to be easily diffable, but data looks substantially the same.

Code: [Select]

old=/home/yakra/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf
new=/home/yakra/gis/data/tx/TxDOT_Highway_Designations-2022-02-07/Highway_Designations.dbf

for r in {0..1076}; do
  echo '#'$r;
  diff <(./DBFquery $old $r | grep -v "^$old opened\.$") \
       <(./DBFquery $new $r | grep -v "^$new opened\.$");
  echo;
done > 20220207a.diff^ Find exact matches

Code: [Select]

old=/home/yakra/gis/data/tx/TxDOT_Highway_Designations-2021-08-13/Highway_Designations.dbf
new=/home/yakra/gis/data/tx/TxDOT_Highway_Designations-2022-02-07/Highway_Designations.dbf

for r in {457..1076}; do
  echo '#'$r;
  diff <(./DBFquery $old $(expr $r + 1) | egrep -v "^$old opened\.$|OBJECTID") \
       <(./DBFquery $new $r | egrep -v "^$new opened\.$|OBJECTID");
  echo;
done > 20220207b.diff^ Find offset matches. Adjust r, expr, and diff filename as needed.

old  | new  | route    | wot
0    |    0 |          | identical
...  |  ... |          | identical
456  |  456 |          | identical
457  | 1034 | SL0368   | Transferred to City of San Antonio -> Remains on State Highway System
458  |  457 |          | match offset by 1
...  |  ... |          | match offset by 1
917  |  916 |          | match offset by 1
918  |      | SL0345   | DSPN_DSCR appears swapped w/919. That's the removal of SL 345; redesignation as SS 345 appears erroneous, so record removed.
919  | 1035 | SS0345   | Redesignate as SS 345 -> Remove Portion of SL 345
920  |  917 |          | match offset by 3
...  |  ... |          | match offset by 3
947  |  944 |          | match offset by 3
948  | 1036 | US0090   | NULL -> Designate US 90 Concurrent with IH 10
949  |  945 |          | match offset by 4
...  |  ... |          | match offset by 4
1037 | 1033 |          | match offset by 4
457  | 1034 | SL0368   | Transferred to City of San Antonio -> Remains on State Highway System
919  | 1035 | SL0345   | Redesignate as SS 345 -> Remove Portion of SL 345
948  | 1036 | US0090   | NULL -> Designate US 90 Concurrent with IH 10
1038 | 1037 |          | match offset by 1
...  |  ... |          | match offset by 1
1059 | 1058 |          | match offset by 1
1060 | 1059 |          | match with missing MO_NBR, APRV_DT & APRV_YR fields filled in
1061 | 1060 |          | match with missing MO_NBR, APRV_DT & APRV_YR fields filled in
1062 | 1061 |          | match with missing MO_NBR, APRV_DT & APRV_YR fields filled in
1063 | 1062 |          | match with missing MO_NBR, APRV_DT & APRV_YR fields filled in
1064 | 1063 |          | match offset by 1
...  |  ... |          | match offset by 1
1067 | 1066 |          | match offset by 1
1068 | 1067 | BU0059-C | Fix for "WTF" above. This allows new BU 59C @ Marshall, and leaves more letters available for future routes northward toward Texarkana. Nothing to change for TM purposes.
1069 | 1068 |          | match offset by 1
...  |  ... |          | match offset by 1
1076 | 1075 |          | match offset by 1
     | 1076 | FM1516   | Designate FM 1516 on New Location

[oscar]

948 1036 US0090 NULL -> Designate US 90 Concurrent with IH 10
    1076

Is that the shift of US 90 from downtown Beaumont to the Interstate, that had been approved by AASHTO ages ago but never carried out?

[mapmikey]

Field postings have been changed to move US 90 onto I-10 through Beaumont:

https://goo.gl/maps/mGTWBNsARtQSVdx38
https://goo.gl/maps/T6o3Gg1NMRBRNTEz5
https://goo.gl/maps/MJ9c9g6zKnWrMFYz6
https://goo.gl/maps/BjuyVLMbMbg4nNRo8
https://goo.gl/maps/xEYv1ZuwDFdHGJPB9

[yakra]

Yes, those records are the Beaumont shift.
US90 was rerouted back onto I-10 in TM on Sep 18, 2020.

[yakra]

2020-08-19 <-> 2021-04-28 diffs
1057 & 1070 total records respectively

Code: [Select]

old=/home/yakra/gis/data/tx/TxDOT_Highway_Designations-shp2020-08/Highway_Designations.dbf
new=/home/yakra/gis/data/tx/TxDOT_Highway_Designations-2021-04-28/Highway_Designations.dbf

for r in {0..1056}; do
  echo '#'$r;
  diff <(./DBFquery $old $(expr $r + 0) | tail -n +10 | grep -v ^STATE) \
       <(./DBFquery $new $(expr $r + 0) | tail -n +10 | grep -v ^STATE);
  echo;
done > 20210428a.diff
^ Find exact matches

Code: [Select]

for r in {1035..1056}; do   echo '#'$r;   ./DBFquery $old $r | tail -n +10 | grep -v ^STATE;   echo; done > 2020-08-19.log
for r in {1035..1069}; do   echo '#'$r;   ./DBFquery $new $r | tail -n +10 | grep -v ^STATE;   echo; done > 2021-04-28.log
^ Human-readable text for the rest

old  | new  | route    | wot
0    |    0 |          | identical
...  |  ... |          | identical
1034 | 1034 |          | identical
1037 | 1035 | FM2087   | Extend FM 2087 on Location of Sabine St and Toledo Cir
1040 | 1036 | FM0146   | Extend FM 146 on location of County Road 203
1041 | 1037 | FS 121   | Designate FM Spur 141 [sic; should be 121] on New Location
1035 | 1038 | FM3406   | match+3
1036 | 1039 | SS0379   | match+3
1037 | 1035 | FM2087   | Extend FM 2087 on Location of Sabine St and Toledo Cir
1038 | 1040 | BU183Q   | match+2
1039 | 1041 | US183    | match+2
1040 | 1036 | FM0146   | Extend FM 146 on location of County Road 203
1041 | 1037 | FS 121   | Designate FM Spur 141 [sic; should be 121] on New Location
1042 | 1042 |          | missing fields filled in
...  |  ... |          | missing fields filled in
1050 | 1050 |          | missing fields filled in
1051 | 1052 | SH0249   | Redesignate Segment of SH 249 as FM 1774
1052 | 1051 | FM1774   | Extend Designation of FM 1774
1053 | 1053 |          | missing fields filled in
...  |  ... |          | missing fields filled in
1056 | 1056 |          | missing fields filled in
...and then the new records

[yakra]

2022-10-14
1088 total records

ID      DSPN_DSCR
1078    Rescinds minute order 114167
1079    Designate segment of US 59 on new location
        western Corrigan bypass
1080    Redesignate a segment of US 59 as BU 59J
        Corrigan
1081    Redesignate existing BU 59J as BU 59K
1082    [field is blank]
        TX US281 US281Trk_S US183_S
1083    [field is blank]
        TX US281TrkLam US183/190 US281_N
1084    [field is blank]
        TX US281TrkLam US281_S US183/190
1085    [field is blank]
        FM56/2114 T-intersection / new construction
1086    [field is blank]
        CR3615 -> FM2114
1087    [field is blank]
        All of CR3615 between the two FM roads
1088    [field is blank]
        TX US77 *US77BusRay $FOO


« Last Edit: November 27, 2022, 09:11:58 am by yakra »

[yakra]

Diffs
from previous versions.
Going forward, take care of diffs & new entries @ same time.

Hashing .shp record contents isn't viable, as geometry & projection keep changing. Keep diffing dumps of of the DSPN_DSCR field.

Code: [Select]

for r in {0..1113}; do ./DBFquery ~/gis/data/tx/TxDOT_Highway_Designations-2024-06-09/Highway_Designations.dbf $r | grep dspn_dscr; done > 2024-06-09.log
diff <(cut -f4 2022-10-14.log | sed 's~ *$~~') <(cut -f4 2024-06-09.log | sed 's~ *$~~')

Date         #rec   DBF field   Disposition
2019-03-26    995   DSPN_DSCR   1st version downloaded.
2020-04-28   1053   DSPN_DSCR   31 descriptions changed. Take a closer look.
2020-08-19   1057   DSPN_DSCR   No diffs to existing. 4 new, added to watchlist, not post.
2021-04-28   1070   DSPN_DSCR   Four shuffled around, 13 new.
2021-08-13   1077   DSPN_DSCR   No diffs to existing. 7 new.
2022-02-07   1077   DSPN_DSCR   Reply #8
2022-10-14   1088   dspn_dscr   No diffs to existing. 11 new.
2024-06-09   1114   dspn_dscr   No diffs to existing. 26 new.

ToDo:
New program to rip shapefiles by record number


2024-06-09
1114 total records

Rec#    dspn_dscr / mo_nbr
1089    Designate US 59 as BU 59-H
        Diboll
1090    ....Designate US 59 along a new location
        Diboll
1091    202399
        TX84 (Hachar-Reuthinger Rd)
1092    [NULL]
        Power St offramp from old Harbor Bridge
1093    202299
        TX FM148 FM3039 US175
1094    202299
        FM148 bypass to US175 @ Cartwright Ranch Pkwy
1095    202299
        FM148 from bypass to FM3039
1096    202299
        US175 / FM148 overlap
1097    Extend SH 68 on New Location
        From E end of FM3072, NE & N to I-2 between 152 & 153
1098    Designate SS 81 on New Location
        From elbow of TX68 SE to FM493
1099    Extend SH 68 Concurrent with FM 3072
        weirdly enough http://www.openstreetmap.org/?lat=26.120162&lon=-98.173467
1100    Designate FM 2001 on new location
        White Wing Trl E of I-35 | GMSV | #7895
1101    Designate FM 2001 on new location
        CR133 diagonal to CR212
1102    Designate FM 2001 on new location
        S from S Quails Run, along CR126 Rohde Rd, SW around built-up area to TX21
1103    Designate FM 2001 on new location
        SW from TX21 to existing alignment @ power line ROW
1104    Designate SH 104 on new location
        2nd S Padre Island causeway
1105    Designate SH 104 on Location of Buena Vista Dr
        S of FM106
1106    202310
        US190BusRog
1107    202310
        Rogers bypass
1108    Redesignate segment of FM 106 as SH 104
1109    Redesignate as FM Spur 2001
        bypassed by record 1100
1110    Redesignate as FM Spur 2001-A
        bypassed by record 1101
1111    Redesignate as FM Spur 2001-B
        bypassed by record 1102 N of TX21
1112    Redesignate as FM Spur 2001-C
        S of TX21 to power line ROW (bypassed by 1103)
1113    Remove FM 2001 concurrency from SH 21
1114    Designate RM 967 as RM Spur 967
        RobLigBlvd. Not actually RM967.