Welcome to DU! The truly grassroots left-of-center political community where regular people, not algorithms, drive the discussions and set the standards. Join the community: Create a free account Support DU (and get rid of ads!): Become a Star Member Latest Breaking News Editorials & Other Articles General Discussion The DU Lounge All Forums Issue Forums Culture Forums Alliance Forums Region Forums Support Forums Help & Search

eppur_se_muova

(41,628 posts)
Tue Mar 3, 2026, 09:33 PM 14 hrs ago

Why are apostrophes -- or is it hyphens -- in some posts suddenly showing up as a scrambled mess ??

Last edited Tue Mar 3, 2026, 10:19 PM - Edit history (2)

Lately, it seems that some peoples' posts can't handle apostrophes -- instead a hash of characters ( � � � s without the spaces) shows up. I haven't changed anything in my browser, and not all posts are doing it, so I have to wonder if this is something new that Microsoft e.g. had done to its text encodings, and that folks who are posting "smart" apostrophes, or some such, are unaware of the problem because they only read their own posts in the same browser that created them.

Any ideas ? Buehler ?


ETA: The characters I originally typed are now showing up repeated three times -- only the s does not repeat. This strikes me as very strange, and may affect DU itself.

24 replies = new reply since forum marked as read
Highlight: NoneDon't highlight anything 5 newestHighlight 5 most recent replies
Why are apostrophes -- or is it hyphens -- in some posts suddenly showing up as a scrambled mess ?? (Original Post) eppur_se_muova 14 hrs ago OP
I was wondering that too Lifeafter70 14 hrs ago #1
Can you link to one? Renew Deal 14 hrs ago #7
It was earlier this afternoon Lifeafter70 13 hrs ago #9
In your browser menu canetoad 14 hrs ago #2
Thanks, I'm using Safari at the moment. Switch to Firefox for bigger jobs. nt eppur_se_muova 14 hrs ago #3
me too, since this afternoon on a thread I posted and on a very old post. bigtree 14 hrs ago #4
Is this the thread? Renew Deal 14 hrs ago #8
That was one I saw but there were others. Lifeafter70 13 hrs ago #10
Pasting one of the offending lines from that post: Renew Deal 13 hrs ago #11
Try editing that post and you'll see the issue AZJonnie 11 hrs ago #20
Just fyi ... Tasmanian Devil 12 hrs ago #15
On that page, I see the problem - I don't know what causes it. Jim__ 13 hrs ago #12
Could be tracking code that's getting passed through Renew Deal 13 hrs ago #13
You should re-post this in the DU Community Help forum. Wednesdays 14 hrs ago #5
Maybe you have a bad browser extension? Renew Deal 14 hrs ago #6
Unlikely, because Wednesdays 13 hrs ago #14
I had the same thing happen late this morning, when I cross-posted this thread highplainsdem 12 hrs ago #16
It's caused by editing or previewing, if you just paste into a post and post it immediately it displays correctly AZJonnie 11 hrs ago #19
It is happening with the 'curly' style single and double quotes like Word does, and it breaks in this way AZJonnie 11 hrs ago #17
If I tried to do a 2nd edit, the 2nd set of sentences would've gotten munged up as well AZJonnie 11 hrs ago #18
Thanks for working all that out ! I kind of figured it was a character set issue, and guessed 'smart' quotes ... eppur_se_muova 10 hrs ago #21
In my experience, it's really likely the issue is happening during I/O with the database AZJonnie 9 hrs ago #22
Thanks ! I've only done a very, very little C programming and know nothing about DBs, servers, etc. but ... eppur_se_muova 9 hrs ago #23
MS didn't invent the characters that are the 'curly' quotes AZJonnie 9 hrs ago #24

canetoad

(20,612 posts)
2. In your browser menu
Tue Mar 3, 2026, 09:42 PM
14 hrs ago

Try "View" > Repair text encoding.
This is for Firefox. You may need to search your settings.

bigtree

(93,974 posts)
4. me too, since this afternoon on a thread I posted and on a very old post.
Tue Mar 3, 2026, 10:01 PM
14 hrs ago

...I can't access any of the fixes suggested.

Seeing this post from you makes me think something else is up, tho.

Renew Deal

(84,899 posts)
11. Pasting one of the offending lines from that post:
Tue Mar 3, 2026, 10:20 PM
13 hrs ago

‘Peace President’ Breaks Record for Attacking the Most Countries

https://www.thedailybeast.com/peace-president-donald-trump-breaks-record-for-attacking-the-most-countries/

Oddly, the excerpted text no longer matches the text in the article.

Here is what I pulled out of the article that is similar:

"In the same period, though, he has ordered strikes against targets across no less than seven nations—Iran, Nigeria, Venezuela, Iraq, Somalia, Syria and Yemen—at a rate that has already outstripped the total sanctioned by Joe Biden throughout the Democratic president’s four years at the White House,"

https://www.thedailybeast.com/peace-president-donald-trump-breaks-record-for-attacking-the-most-countries/

Not seeing the issue anymore

AZJonnie

(3,504 posts)
20. Try editing that post and you'll see the issue
Wed Mar 4, 2026, 12:37 AM
11 hrs ago

Your curly quote will appear as the weird three characters in the window where you go to make edits, and will post that way if you re-post.

Tasmanian Devil

(124 posts)
15. Just fyi ...
Tue Mar 3, 2026, 11:11 PM
12 hrs ago

That page looks fine to me. Not a lot of help I know, but fyi. The characters around Peace President are unicode open and close quotes (3 bytes each).

Jim__

(15,167 posts)
12. On that page, I see the problem - I don't know what causes it.
Tue Mar 3, 2026, 10:31 PM
13 hrs ago

The line in the DU post: �Peace president� breaks record for attacking the most countries

When I right click on the du page and go to view page source, I see : �Peace president� breaks record for attacking the most countries

When I go to the Daily Beast source and do view source page, I see this (in a very long line): "description":{"basic":""},"display_date":"2026-03-02T14:15:32.449Z","distributor":{"category":"staff","name":"thedailybeast","subcategory":""},"first_publish_date":"2026-03-02T14:15:32.449Z","geo":{},"headlines":{"basic":"‘Peace President’ Breaks Record for Attacking the


Wednesdays

(22,317 posts)
5. You should re-post this in the DU Community Help forum.
Tue Mar 3, 2026, 10:05 PM
14 hrs ago

I've been having similar issues today, as well.

Wednesdays

(22,317 posts)
14. Unlikely, because
Tue Mar 3, 2026, 11:00 PM
13 hrs ago

They're using Safari, and I'm on Firefox, and I had the same problem.

highplainsdem

(61,388 posts)
16. I had the same thing happen late this morning, when I cross-posted this thread
Tue Mar 3, 2026, 11:25 PM
12 hrs ago
https://www.democraticunderground.com/100221066192

to this

https://www.democraticunderground.com/114238864

but I redid the text and the second time I copied it, it turned out OK.

Haven't noticed it in any other messages I posted today.

AZJonnie

(3,504 posts)
19. It's caused by editing or previewing, if you just paste into a post and post it immediately it displays correctly
Wed Mar 4, 2026, 12:34 AM
11 hrs ago

It's the editing and previewing processes (see my posts 17 and 18 below ) that create the character set issue.

AZJonnie

(3,504 posts)
17. It is happening with the 'curly' style single and double quotes like Word does, and it breaks in this way
Wed Mar 4, 2026, 12:19 AM
11 hrs ago

when the user Edits (or Previews) their post.

�Here is a sentence encased in double quotes done on a PC in Word and pasted to DU�
�Here is a sentence encased in double quotes done on a PC in Word and pasted to DU�

If I post that directly without preview, the proper characters show. But if I preview first, when I get to the preview window, they're all four munged up with 3 characters that are NOT quotes.

I EDITED the above content just now, and now I'll paste the same two sentences in that I posted the first time:
“Here is a sentence encased in double quotes done on a PC in Word and pasted to DU”
‘Here is a sentence encased in double quotes done on a PC in Word and pasted to DU’

AZJonnie

(3,504 posts)
18. If I tried to do a 2nd edit, the 2nd set of sentences would've gotten munged up as well
Wed Mar 4, 2026, 12:28 AM
11 hrs ago

But because I posted directly and did not preview first, they posted correctly (that 2nd time).

It's the DU site that's doing this, and it is almost surely a Windows (ISO‑8859‑1 / Windows‑1252) vs UTF-8 character set issue.

eppur_se_muova

(41,628 posts)
21. Thanks for working all that out ! I kind of figured it was a character set issue, and guessed 'smart' quotes ...
Wed Mar 4, 2026, 01:55 AM
10 hrs ago

... because that came up once before, quite a long time ago. But then it started to seem *maybe* more complicated than that.

AZJonnie

(3,504 posts)
22. In my experience, it's really likely the issue is happening during I/O with the database
Wed Mar 4, 2026, 02:13 AM
9 hrs ago

In particular when data is pulled out of the DB and placed onto the DU form. When you're in "Preview" or "Edit" mode, what you're looking at (the text you're able to edit) has already made a round trip to the DB (your initial draft was saved to the DB IOW).

Now, that's also true when you just make a post and it shows up on the site (which is also reading posts from the database) but this a different sort of operation (using the web server) vs. pulling data out of the DB to enable editing (uses an app server typically, which is different software vs the web server).

The fact the problem only occurs when a post is edited by a user (but an UNEDITED post shows up fine on the forums) tells me the problem almost surely occurs when pulling data from the DB into the Editor. I'd expect something to the effect that the DB stores the data as UTF-8 (pretty sure DU is on mysql database, and some form of UTF-8 is default), the Web Server expects the same form of UTF-8, but the EDITOR expects a character set that's somehow different (could be a different UTF-8 version, of which there are a few, or maybe Windows).

They are sets that are LARGELY translatable seamlessly, but some characters (and smart quotes are notorious for this) don't translate perfectly, so we get these wrong characters show up in the Edit/Preview window, and then these 'wrong' characters save to the DB when the user updates, and then show up on the site as wrong.


eppur_se_muova

(41,628 posts)
23. Thanks ! I've only done a very, very little C programming and know nothing about DBs, servers, etc. but ...
Wed Mar 4, 2026, 02:22 AM
9 hrs ago

it's nice to know it's something rational and technological, not unhappy demons or, worse, hostile mobile code. My browser is set to the "default" character set; I think I'm going to force it to UTF-8 for a while and see what happens.

In my experience, saying "it's Microsoft's fault" at the beginning of the process often saves time, so that was my first thought. Didn't they invent smart quotes ??

AZJonnie

(3,504 posts)
24. MS didn't invent the characters that are the 'curly' quotes
Wed Mar 4, 2026, 02:41 AM
9 hrs ago

But it may be the case that Word was the first program (or at least the first really famous one) that automatically converted to them as you typed and sorta 'pairs them up' for you, such that the first one you type curves one way (an 'open' version, if you will), then the next one (in the same line) curves the other way (the 'closing' version). Like so: “Example”. I used the same key for both of those double-quotes, and Word converted them to an open/close pairing like that, that's where the "smart" part comes in.

I don't know that the browser's character set setting impacts this at all, I suspect the issue is already there before you actually see it rendered in your browser but I don't care enough to dig into it, nor know if I could even figure it out. If I was going to guess, it'd be a translation issue happening with the ODBC or JDBC database driver that connects the app server to the DB, which means basically at the exact point the data is pulled from the DB, before anything else happens to it downstream.

Latest Discussions»General Discussion»Why are apostrophes -- or...