Travel Mapping

User Discussions => Welcome & Notices => Topic started by: Jim on July 19, 2021, 10:11:29 am

Title: Server OS and software updates
Post by: Jim on July 19, 2021, 10:11:29 am
I'm going to apply some OS updates and probably update some software versions today, July 19.  Expect little impact, hopefully just a quick reboot or two, but you never know.
Title: Re: Server OS and software updates
Post by: Jim on July 19, 2021, 01:13:15 pm
I've worked around but not yet understood or solved the problem that caused the earlier downtime.  Expect a little more disruption as I continue to investigate and try things.
Title: Re: Server OS and software updates
Post by: Jim on July 19, 2021, 02:01:06 pm
I think we're good now.  The package update system replaced a symbolic link needed on startup with a new directory that of course didn't have the right contents, and the MySQL server startup script was hanging at boot time.  This was the first package update of MySQL since the DB moved to the SSD drives earlier this year.  Now I know.
Title: Re: Server OS and software updates
Post by: Jim on January 13, 2022, 10:34:09 pm
I'm planning to update the server's FreeBSD version some time during the day on Friday, January 14.  While I'm in, I'll probably update all software versions.  It's a minor version update so I don't anticipate any complications, but you never know.  Expect occasional down time at some point during the day, with the possibility of a longer outage if I run into any trouble.
Title: Re: Server OS and software updates
Post by: Jim on January 14, 2022, 11:43:18 am
Everything appears to have gone smoothly, should be back to normal now.
Title: Re: Server OS and software updates
Post by: Jim on March 19, 2022, 03:58:55 pm
I did a quick reboot in the last few minutes (mid-afternoon 3/19) to bring in a couple recent security patches.  As far as I can tell, everything came back up normally.  Let me know if you notice anything that looks broken.
Title: Re: Server OS and software updates
Post by: Jim on June 10, 2022, 09:12:58 am
I just made some security modifications, mostly restricting public reporting info, and applied the latest security patches to the server.  As far as I can tell, everything is operating normally, but let me know if you notice anything unusual.

I plan to update some versions of things next week, then do a major OS version update in mid-July.
Title: Re: Server OS and software updates
Post by: Jim on July 11, 2022, 10:39:34 pm
I'm aiming for an OS version update on TM and METAL's server one day next week.  I'll try to give a few days notice when I set a time.  There would be a few short outages if all goes well, longer if problems arise.
Title: Re: Server OS and software updates
Post by: Jim on July 14, 2022, 03:38:55 pm
I am tentatively planning to start the OS update on Monday, 7/18, around 10 AM EDT.  The whole process should take an hour or two. If all goes well, you'll barely notice, with only some brief outages when I need to boot into a new kernel and restart various updated system services for software updates that will follow the OS update.  There's always the chance of complications and a more lengthy outage.
Title: Re: Server OS and software updates
Post by: yakra on July 14, 2022, 09:15:41 pm
FreeBSD 13.1?
Title: Re: Server OS and software updates
Post by: Jim on July 14, 2022, 11:26:41 pm
FreeBSD 13.1?

If all goes well, yes.
Title: Re: Server OS and software updates
Post by: Jim on July 18, 2022, 10:32:49 am
Getting started now with the update to FreeBSD 13.1.
Title: Re: Server OS and software updates
Post by: Jim on July 18, 2022, 12:59:39 pm
We're back up, though definitely some PHP configuration needed to get the main TM site running again.
Title: Re: Server OS and software updates
Post by: Jim on July 18, 2022, 01:55:35 pm
Attempting to remedy by updating PHP from 7.2 to 7.4.  Forum's back.  HDX is back.  TM still won't load.
Title: Re: Server OS and software updates
Post by: Jim on July 18, 2022, 02:23:07 pm
OK, I've got a workaround to the last weird PHP problem.  If everything else looks good, I'm going to go with it as a permanent solution.  Please try out all TM functionality you use and report anything that has broken.
Title: Re: Server OS and software updates
Post by: michih on July 18, 2022, 02:29:33 pm
showroute.php does currently not work:

https://travelmapping.net/hb/showroute.php?u=michih&r=bel.a001

Code: [Select]
Fatal error: Uncaught Error: Call to undefined function ctype_alpha() in /fast/www/tm/lib/tmphpfuncs.php:481 Stack trace: #0 /fast/www/tm/hb/showroute.php(192): tm_validate_root('bel.a001') #1 {main} thrown in /fast/www/tm/lib/tmphpfuncs.php on line 481
Title: Re: Server OS and software updates
Post by: michih on July 18, 2022, 02:32:07 pm
btw: Is there any reason that you didn't run a site update last night? You also didn't run it after the OS upgrade but I think you should check if it works. Just my 2ct....
Title: Re: Server OS and software updates
Post by: Jim on July 18, 2022, 03:15:39 pm
btw: Is there any reason that you didn't run a site update last night? You also didn't run it after the OS upgrade but I think you should check if it works. Just my 2ct....

No good reason, I think I thought I had started it, but didn't!  I will run one when I get home.
Title: Re: Server OS and software updates
Post by: rickmastfan67 on July 18, 2022, 03:45:49 pm
OK, I've got a workaround to the last weird PHP problem.  If everything else looks good, I'm going to go with it as a permanent solution.  Please try out all TM functionality you use and report anything that has broken.

Mapviewer is broken.
Code: [Select]
Fatal error: Uncaught Error: Call to undefined function ctype_alpha() in /fast/www/tm/lib/tmphpfuncs.php:481 Stack trace: #0 /fast/www/tm/hb/showroute.php(192): tm_validate_root('pa.us030') #1 {main} thrown in /fast/www/tm/lib/tmphpfuncs.php on line 481
Title: Re: Server OS and software updates
Post by: michih on July 18, 2022, 03:49:53 pm
OK, I've got a workaround to the last weird PHP problem.  If everything else looks good, I'm going to go with it as a permanent solution.  Please try out all TM functionality you use and report anything that has broken.

Mapviewer is broken.
Code: [Select]
Fatal error: Uncaught Error: Call to undefined function ctype_alpha() in /fast/www/tm/lib/tmphpfuncs.php:481 Stack trace: #0 /fast/www/tm/hb/showroute.php(192): tm_validate_root('pa.us030') #1 {main} thrown in /fast/www/tm/lib/tmphpfuncs.php on line 481

Mapviewer? mapview.php works for me. Your error message indicates showroute.php though. It's exactly what I reported upthread. Seems to be a general problem.
Title: Re: Server OS and software updates
Post by: Markkos1992 on July 18, 2022, 03:51:22 pm
Mapview works fine for me too.
Title: Re: Server OS and software updates
Post by: rickmastfan67 on July 18, 2022, 03:55:34 pm
Mapview works fine for me too.

I just call it that. lol.
Title: Re: Server OS and software updates
Post by: IMGoph on July 18, 2022, 05:42:18 pm
showroute.php does currently not work:

https://travelmapping.net/hb/showroute.php?u=michih&r=bel.a001

Code: [Select]
Fatal error: Uncaught Error: Call to undefined function ctype_alpha() in /fast/www/tm/lib/tmphpfuncs.php:481 Stack trace: #0 /fast/www/tm/hb/showroute.php(192): tm_validate_root('bel.a001') #1 {main} thrown in /fast/www/tm/lib/tmphpfuncs.php on line 481

I'm still seeing this error as well.
Title: Re: Server OS and software updates
Post by: Jim on July 18, 2022, 05:55:02 pm
OK, I'll check it out when I can.  I have no idea why almost all of PHP works, but now 2 specific functions can't be found.
Title: Re: Server OS and software updates
Post by: Jim on July 18, 2022, 06:13:47 pm
Looks like a function that used to be in the core is now in an optional package.  The showroute page is now working for me.  Keep the reports coming if you find problems, thanks.
Title: Re: Server OS and software updates
Post by: Markkos1992 on July 18, 2022, 06:17:50 pm
A couple of the Albania names look odd with question marks in the name.  I am not sure if that is related to this.

And yes, the showroute page is working for me too.
Title: Re: Server OS and software updates
Post by: andrepoiy on July 18, 2022, 06:24:56 pm
Accents (see Quebec) have also become question marks
Title: Re: Server OS and software updates
Post by: michih on July 18, 2022, 06:40:53 pm
Now, something is wrong with mapview.php.

https://travelmapping.net/user/mapview.php?u=michih&rg=LIE works well (very little graph) but https://travelmapping.net/user/mapview.php?u=michih&rg=BEL or any "larger" graph doesn't load (within 5 minutes or more).
Title: Re: Server OS and software updates
Post by: Bickendan on July 18, 2022, 06:47:04 pm
Ah, that explains the snag I had earlier where the new posts icons weren't clearing on refresh and clicking on threads triggered Chrome to download index.php (resolved btw)
Title: Re: Server OS and software updates
Post by: michih on July 18, 2022, 07:32:21 pm
Thanks for the fixes so far! :)

A couple of the Albania names look odd with question marks in the name.  I am not sure if that is related to this.

Same for other regions which worked before, e.g. in system names "Landesstraßen" and many city names: https://travelmapping.net/hb/?u=sys=deunwl
Title: Re: Server OS and software updates
Post by: kjslaughter on July 18, 2022, 08:54:34 pm
Maybe it's just me as a regular user, but the I can't get any of the site to load.  Whether I follow my bookmarks, type in link or click link from forum, my browser just tries to open a download rather than the website.  Issue same on Chrome and Edge.  So, I see you guys saying you can get in, but as a general public user, it's been a no go since about noon ET.  I checked this AM looking for my updates, but they had not been loaded, so hen I came back later in day, it just wasn't working at all and still have same issue.

EDIT - I just clicked on above links in forum and was able to get around home page to my stats, but the "TM Home" link takes me to the same download and my bookmark straight to my stats still yields download.  So, something is still not quite right.
Title: Re: Server OS and software updates
Post by: Jim on July 18, 2022, 08:58:13 pm
Got the encoding problem sorted out (though I don't know why I didn't need this before).

Still stumped on the slowness of mapview.  I'll keep looking.

@kjslaughter is it possible you have something cached with a mix of old and updated code?  Seems unlikely that's the case but I am not sure what else might be going on for you.
Title: Re: Server OS and software updates
Post by: kjslaughter on July 18, 2022, 09:01:11 pm
Yeah, I cleared my cache and rebooted browser to no affect.  It's really weird.
Title: Re: Server OS and software updates
Post by: Jim on July 18, 2022, 09:13:21 pm
Mapview speed looks better to me.  I don't think I changed anything.  @michih how is it looking on your end?
Title: Re: Server OS and software updates
Post by: michih on July 19, 2022, 01:01:28 am
Mapview speed looks better to me.  I don't think I changed anything.  @michih how is it looking on your end?

Fine now! Thanks! I don't notice any problem with the "normal pages" this morning. Did anyone check out wpt editor? HDX?
Title: Re: Server OS and software updates
Post by: SSOWorld on July 20, 2022, 08:05:34 pm
Mapview speed looks better to me.  I don't think I changed anything.  @michih how is it looking on your end?
Alaska or Kentucky? ;)
Title: Re: Server OS and software updates
Post by: Markkos1992 on July 20, 2022, 09:25:39 pm
I had no issues with HDX when I used it for the components project after Monday's issue.
Title: Re: Server OS and software updates
Post by: osu-lsu on July 21, 2022, 12:27:49 pm
Mapview speed looks better to me.  I don't think I changed anything.  @michih how is it looking on your end?
Alaska or Kentucky? ;)
I dunno. Ohio & Pennsylvania seemed "slow" to me last night, but there are too many ingredients in the code (and pathways) for me to make heads or tails about anything around here.
Title: Re: Server OS and software updates
Post by: yakra on July 22, 2022, 08:46:42 am
^ Makes sense as there are lots of segments in those regions.
Title: Re: Server OS and software updates
Post by: michih on July 26, 2022, 04:03:12 pm
The special character issue is not yet solved: https://travelmapping.net/hb/
23 system names still contain "?", e.g. cypd, czei, czeii, frapacm06, hunf, jpne,...
Title: Re: Server OS and software updates
Post by: Jim on July 26, 2022, 08:26:00 pm
The special character issue is not yet solved: https://travelmapping.net/hb/
23 system names still contain "?", e.g. cypd, czei, czeii, frapacm06, hunf, jpne,...

I wonder if these are using characters not in utf8 or something like that.
Title: Re: Server OS and software updates
Post by: yakra on July 26, 2022, 10:15:51 pm
FWIW I see all these characters on lab2. Except for the one in frapacm06. That's a non-character, not even showing up as a blank space. I see Métropole‎ Nice Côte d'Azur Routes Métropolitaines, even when I output systems.csv to my shell.
The bytes in question are E2 80 8E.

The other systems' bytes:
cypd C4 B1
czei/czeii C5 99
hunf C5 91
jpne C5 8D (all three)
Title: Re: Server OS and software updates
Post by: michih on July 27, 2022, 02:02:33 pm
FWIW I see all these characters on lab2. Except for the one in frapacm06. That's a non-character, not even showing up as a blank space. I see Métropole‎ Nice Côte d'Azur Routes Métropolitaines, even when I output systems.csv to my shell.
The bytes in question are E2 80 8E.

Well, it's correct but there is a ? between e and blank for whatever reason.
It's also wrong on updates.php (https://travelmapping.net/devel/updates.php?syscount=640).
It's correct on the forum:

frapacm06 - Métropole‎ Nice Côte d'Azur Routes Métropolitaines reviewer: t.b.d.

I copied this text into my local copy of systems.csv and systemupdates.csv but Github does not recognize any change. I cannot upload it - because changed.

Any idea? Again, it's a simpe e + blank.


The other issues are another story thoug.
Title: Re: Server OS and software updates
Post by: Bickendan on July 27, 2022, 02:33:32 pm
Hopefully it's not something silly like swapping out the é with it's ascii code alt-0233
Title: Re: Server OS and software updates
Post by: michih on July 27, 2022, 02:53:00 pm
Any idea? Again, it's a simpe e + blank.

The file had three characters as I realized when pressing the cursor button. I overwrote it by e and I think frapacm06 should be fine now: https://github.com/TravelMapping/HighwayData/pull/5943
Title: Re: Server OS and software updates
Post by: Markkos1992 on August 09, 2022, 08:20:19 pm
I see a weird question mark in the DK5 updates entry from 8-6-2022.
Title: Re: Server OS and software updates
Post by: Jim on August 23, 2022, 10:44:50 am
I applied quick security patch this morning.  Let me know if you notice any problems.
Title: Re: Server OS and software updates
Post by: Markkos1992 on August 23, 2022, 11:29:51 am
I see a weird question mark in the DK5 updates entry from 8-6-2022.

I am still seeing this issue.  Some of the 8-19-2022 updates entries have that issue as well.
Title: Re: Server OS and software updates
Post by: michih on August 23, 2022, 11:41:15 am
I see a weird question mark in the DK5 updates entry from 8-6-2022.

I am still seeing this issue.  Some of the 8-19-2022 updates entries have that issue as well.

Sure because it is still not fixed for the whole website.
Title: Re: Server OS and software updates
Post by: yakra on August 23, 2022, 08:29:13 pm
BSD/Apache version and/or config?
Title: Re: Server OS and software updates
Post by: Jim on August 23, 2022, 10:51:39 pm
BSD/Apache version and/or config?

Could be Apache, could be PHP.  I haven't been able to figure out what setting, though I haven't looked too hard.
Title: Re: Server OS and software updates
Post by: Markkos1992 on August 26, 2022, 06:34:37 am
I am dealing with Route Finder memory issues again.  I thought it was just my personal laptop, but I tried it on my work laptop and had the same issue.
Title: Re: Server OS and software updates
Post by: Jim on August 26, 2022, 08:24:38 am
I am dealing with Route Finder memory issues again.  I thought it was just my personal laptop, but I tried it on my work laptop and had the same issue.

No changes there in a while, just more routes in the DB.  The page loads up for me in a couple second seconds, all functionality seems to be good.  Column filters take 3-4 seconds to complete.  That said, we know it's memory intensive, so expect it to be a problem if things can't fit in main memory.
Title: Re: Server OS and software updates
Post by: Jim on August 30, 2022, 11:28:02 pm
Another security patch tonight, will need a quick reboot after tonight's site update finishes.
Title: Re: Server OS and software updates
Post by: Jim on January 17, 2023, 09:30:00 pm
I'm planning to do some OS and software updates on the TM server on Wednesday, January 18.  If all goes well, there will be nothing visible to users beyond a likely quick reboot or two.
Title: Re: Server OS and software updates
Post by: Jim on January 18, 2023, 11:14:58 am
I'm planning to do some OS and software updates on the TM server on Wednesday, January 18.  If all goes well, there will be nothing visible to users beyond a likely quick reboot or two.

All done, let me know if anything looks problematic.
Title: Re: Server OS and software updates
Post by: Jim on March 08, 2023, 09:41:10 am
A few security patches have come out that I'd like to apply this afternoon, 3/8.  I am aiming for 2-3 PM EST. I expect only a quick reboot or two, so a minimal disruption, if all goes well.
Title: Re: Server OS and software updates
Post by: Jim on March 08, 2023, 02:08:14 pm
A few security patches have come out that I'd like to apply this afternoon, 3/8.  I am aiming for 2-3 PM EST. I expect only a quick reboot or two, so a minimal disruption, if all goes well.

All done.  Things look normal so far - let me know if you see any problems.
Title: Re: Server OS and software updates
Post by: Jim on May 06, 2023, 05:26:08 pm
I plan to do a minor version upgrade (FreeBSD 13.1 to FreeBSD 13.2) on TM/METAL's server along with an update of all installed software to latest versions on Tuesday 5/9, hopefully mid to late morning EDT.  If all goes well, we should only see down time from one or two system reboots.
Title: Re: Server OS and software updates
Post by: Jim on May 09, 2023, 10:58:35 am
The update to FreeBSD 13.2 and upgrade of all installed packages to their latest versions is complete.  Please let me know if you notice any problems.
Title: Re: Server OS and software updates
Post by: Jim on September 05, 2023, 03:32:28 pm
Doing a quick OS update, should be very minor with only a couple minutes of downtime, if that.
Title: Re: Server OS and software updates
Post by: Jim on September 06, 2023, 10:20:12 am
Doing a quick OS update, should be very minor with only a couple minutes of downtime, if that.

Finishing it up with what I hope is a quick reboot this morning.  Let me know if you notice any problems after about 10:40 EDT.