Author Topic: Mishandling of accented characters  (Read 1742 times)

Offline Bodhicandra

  • Member
  • Posts: 207
    • View Profile
Mishandling of accented characters
« on: July 07, 2010, 03:04:21 am »
There seems to be a new problem - accented characters in posts are being displayed in mangled forms.

Has this happened since the 'new server' was brougt into use (I've not been in to the site for a few weeks)?

Can the 'new server' - hardware or software - not cope with UTF-8 characters?

Hopefully, this is just a web server container setting going wrong, and not a permanent loss of non-ASCII characters during server migration.

"Your first task on the path is to learn to stop being a nuisance to the world"
adapted from Chögyam Trungpa Rinpoche

Offline meez

  • Global Moderator
  • Member
  • *****
  • Posts: 378
    • View Profile
Re: Mishandling of accented characters
« Reply #1 on: July 07, 2010, 07:55:57 am »
There seems to be a new problem - accented characters in posts are being displayed in mangled forms.

Has this happened since the 'new server' was brougt into use (I've not been in to the site for a few weeks)?

Can the 'new server' - hardware or software - not cope with UTF-8 characters?

Hopefully, this is just a web server container setting going wrong, and not a permanent loss of non-ASCII characters during server migration.



Yes, we are aware of the language/character issues.  Wonky has been a bit busy lately and I'm sure will tend to it as soon as possible.  Thank you again for pointing it out and giving feedback, my friend.

Offline Wonky Badger

  • Administrator
  • Member
  • *****
  • Posts: 1439
    • View Profile
Re: Mishandling of accented characters
« Reply #2 on: July 26, 2010, 06:06:15 am »
I might just have fixed the problem!

今日は!

áàåäö

Was this you meant with accented characters?

The problem was burried a bit inside the database so it took a while to find it. I changed collation earlier but that procedure apparently didn't change the collation in all places of the database. It only changed the table collation.
My actions are my only true belongings.
I cannot escape the consequences of my actions.
My actions are the ground on which I stand.
---
What would Buddha do?

Offline heybai

  • Member
  • Posts: 2145
    • View Profile
Re: Mishandling of accented characters
« Reply #3 on: July 26, 2010, 06:31:09 am »
我們有中文。生活是美好的 !!!

Yeshe Zopa

  • Guest
Re: Mishandling of accented characters
« Reply #4 on: July 26, 2010, 06:35:21 am »


The problem was burried a bit inside the database so it took a while to find it. I changed collation earlier but that procedure apparently didn't change the collation in all places of the database. It only changed the table collation.

I am more likely to understand what Heybai wrote than Admin techspeak! LOL :)

I still have a weird problem in that Firefox won't give me access to formatting or emoticons when replying to a post, but it works fine on Google Chrome. I reckon one of the Firefox updates has a bug. Shame, as I like it.
« Last Edit: July 26, 2010, 06:37:29 am by Yeshe Zopa »

Offline Bodhicandra

  • Member
  • Posts: 207
    • View Profile
Re: Mishandling of accented characters
« Reply #5 on: July 26, 2010, 08:33:07 am »


...

Was this you meant with accented characters?

It does not seem to have fixed it.

In the teacher's name in my signature, reproduced here:

Chögyam Trungpa Rinpoche

the third letter should display as an O with an umlaut (two dots) above it. It's currently (on my Chrome browser) displaying as two letters: an A with a tilde above it and the reverse-P paragraph mark.

It did display OK a month or so ago, and I've not edited it since then.

There are other examples I can see in my and other's posts.

Any more I can do to help diagnose the problem?
"Your first task on the path is to learn to stop being a nuisance to the world"
adapted from Chögyam Trungpa Rinpoche

Offline Wonky Badger

  • Administrator
  • Member
  • *****
  • Posts: 1439
    • View Profile
Re: Mishandling of accented characters
« Reply #6 on: July 26, 2010, 10:40:13 am »


...

Was this you meant with accented characters?

It does not seem to have fixed it.

In the teacher's name in my signature, reproduced here:

Chögyam Trungpa Rinpoche

the third letter should display as an O with an umlaut (two dots) above it. It's currently (on my Chrome browser) displaying as two letters: an A with a tilde above it and the reverse-P paragraph mark.

It did display OK a month or so ago, and I've not edited it since then.

There are other examples I can see in my and other's posts.

Any more I can do to help diagnose the problem?
Have you tried typing it again or did you copy-paste it from the current signature? It's stored in the database as ö, but if you edit it to ö and save, it should stay like that.
My actions are my only true belongings.
I cannot escape the consequences of my actions.
My actions are the ground on which I stand.
---
What would Buddha do?

Yeshe Zopa

  • Guest
Re: Mishandling of accented characters
« Reply #7 on: August 01, 2010, 11:10:31 am »
The 'rude words' filter is still attacking innocent words and pooping on them.  

I posted soemthing on the Tendai thread and look what happened:

'''Domo Arigato Gozaimapoopiese!''

The word is Gozaimas-h-i-t-e.

A fine way to thank someone!   LOL :)

Can the filter be set to pick up the words and correct only if there is a space either side of the word concerned.  So s-h-i-t on its own is changed, but not when within another word?
« Last Edit: August 01, 2010, 11:31:05 am by Yeshe Zopa »

Offline zerwe

  • Member
  • Posts: 359
    • View Profile
Re: Mishandling of accented characters
« Reply #8 on: August 01, 2010, 11:46:33 am »
Yes, I had the same problem with Shantaraksh-i-ta and Wonky fixed it. However, the poopie problem has returned.
Shaun :namaste:

Offline catmoon

  • Member
  • Posts: 1599
    • View Profile
Re: Mishandling of accented characters
« Reply #9 on: August 01, 2010, 01:24:18 pm »
Yes, I had the same problem with Shantaraksh-i-ta and Wonky fixed it. However, the poopie problem has returned.
Shaun :namaste:


I know what this board needs. More fibre!
Sergeant Schultz was onto something.

Yeshe Zopa

  • Guest
Re: Mishandling of accented characters
« Reply #10 on: August 01, 2010, 01:45:33 pm »
Yes, I had the same problem with Shantaraksh-i-ta and Wonky fixed it. However, the poopie problem has returned.
Shaun :namaste:


I know what this board needs. More fibre!

Noooooo!  More fibre means more poop!

Feed these people kaolin! nature's intestinal concrete!  LOL :)

Offline Wonky Badger

  • Administrator
  • Member
  • *****
  • Posts: 1439
    • View Profile
Re: Mishandling of accented characters
« Reply #11 on: August 01, 2010, 10:06:44 pm »
I tried a different solution this time, so I hope it's working now.
My actions are my only true belongings.
I cannot escape the consequences of my actions.
My actions are the ground on which I stand.
---
What would Buddha do?

Offline Ron-the-Elder

  • Member
  • Posts: 4471
  • May all beings live rightly and harmoniously.
    • View Profile
Re: Mishandling of accented characters
« Reply #12 on: August 02, 2010, 02:42:58 am »
So, we can now write "poopies", "cluck", "damn", "egg roll", "hell", and "motherclucker" without any fear of instant censoring? :gawrsh:

Also, I tried to report this post to the moderator, but wasn't allowed to for some reason.  It responded with a message that "it didn't make sense."....when testing the system for oversights clearly does.  It appears that "motherclucker", "egg roll", "damn", "hell", and "fear" are still allowed.

Seems like a lot of dukkha to me!
« Last Edit: August 02, 2010, 02:47:43 am by Bodhisatta2010 »
What Makes an Elder? :
A head of gray hairs doesn't mean one's an elder. Advanced in years, one's called an old fool.
But one in whom there is truth, restraint, rectitude, gentleness,self-control, he's called an elder, his impurities disgorged, enlightened.
-Dhammpada, 19, translated by Thanissaro Bhikkhu.

Offline Wonky Badger

  • Administrator
  • Member
  • *****
  • Posts: 1439
    • View Profile
Re: Mishandling of accented characters
« Reply #13 on: August 02, 2010, 03:51:40 am »
So, we can now write "poopies", "cluck", "damn", "egg roll", "hell", and "motherclucker" without any fear of instant censoring? :gawrsh:

Also, I tried to report this post to the moderator, but wasn't allowed to for some reason.  It responded with a message that "it didn't make sense."....when testing the system for oversights clearly does.  It appears that "motherclucker", "egg roll", "damn", "hell", and "fear" are still allowed.

Seems like a lot of dukkha to me!
Well just have to keep adding them as they pop up. Unfortunately some of those words, even though they might be undesirable, are likely valid parts of some of the discussions here. If we're having a discussion about hell, it would seem a bit silly if it was constantly replaced with "heck" or similar.
My actions are my only true belongings.
I cannot escape the consequences of my actions.
My actions are the ground on which I stand.
---
What would Buddha do?

Yeshe Zopa

  • Guest
Re: Mishandling of accented characters
« Reply #14 on: August 02, 2010, 06:50:44 am »
So, we can now write "poopies", "cluck", "damn", "egg roll", "hell", and "motherclucker" without any fear of instant censoring? :gawrsh:

Also, I tried to report this post to the moderator, but wasn't allowed to for some reason.  It responded with a message that "it didn't make sense."....when testing the system for oversights clearly does.  It appears that "motherclucker", "egg roll", "damn", "hell", and "fear" are still allowed.

Seems like a lot of dukkha to me!
Well just have to keep adding them as they pop up. Unfortunately some of those words, even though they might be undesirable, are likely valid parts of some of the discussions here. If we're having a discussion about hell, it would seem a bit silly if it was constantly replaced with "heck" or similar.

Seems to work OK on s-h-i-t within a word.  Could it now please be tweaked to deal with the rest of the bullshit I write? LOL :)

 


SimplePortal 2.3.3 © 2008-2010, SimplePortal