[ www.netezza.com ]
Currently Being Moderated

Sync problem from SQL Server to Netezza

Posted by SRIDHAR BABU on Aug 17, 2009 4:00:43 PM

Hi Good Monring all,

 

We are syncing the Data from SQL Server to Netezza and some special charactes are not converting

 

For Example  -

 

MC21-‘90s [SQL Server]               MC21-?90s [Netezza]

Please can some one help me

thanks



Aug 17, 2009 4:19 PM Shawn Fox Shawn Fox    says:

The blog is not the appropriate place for this question, but most likely your issue is that you are using the Windows-1252 character set in your SQL-Server database.  Windows-1252 has a subset of characters which do not map to other more standard character sets and you'll have to replace them with spaces or write some manual code to translate the characters to UTF-8.  In the future you should make sure to configure SQL Server to use a standard character set such as UTF8 instead of Windows-1252 and you will not have this type of problem.

Aug 18, 2009 12:25 AM Hemant Kumar Hemant Kumar    says in response to Shawn Fox:

I am agree with Shawn, this problem is due to mismatch of charachter set.

Aug 18, 2009 9:30 AM SRIDHAR BABU SRIDHAR BABU    says in response to Shawn Fox:

first of all thanks for your reply.

Aug 21, 2009 1:15 AM bmasna bmasna    says in response to SRIDHAR BABU:

I had same problem when loading data from SQL server to Oracle.As you already know this happens due to windows and UTF8 charset. So, here is what i did to fix issue. normally we create external table for the file in Oracle using "RECORDS delimited BY newline CHARACTERSET WE8MSWIN1252 " in ORGANIZATION EXTERNAL  options.

Then do below, to read properly,

select cam_name,CONVERT(cam_name, 'WE8MSWIN1252','AL32UTF8' ) from ext_table

 

Convert will do the trick and all international characters get loaded properly. you normally find problems with chinese/japanse/indian characters. hope this helps.