Replace function refusing to work for null (\u0000) carriage return (\r) and newline (\n) characters

[Vitss]

I'm trying to make a flow that is working with a .json file on an onprem server.

So in a nutshell:

1. Connector Filesystem (Get File content using path' over onprem datagateway working fine.

2.compose action with the output:

3. compose action with the base64ToString(outputs('Get_file_content_using_path')?['body']?['$content'])

4. no matter if I clean this content or not (removing ��) I need to replace the null bytes (\u0000) newline and other 'trash' values (\r, \n) 

5. next expression does not do their job, no error but same value as output:

•  replace(outputs('DecodedContent'), '\u0000', '') 
• replace(outputs('DecodedContent'), '\x00', ''), 
• replace(outputs('DecodedContent'), '\0', ''), 
• replace(outputs('DecodedContent'), '\r', ''), 
• replace(string(outputs('DecodedContent')), '\n', '')

6. Splitting the string also does not work completely:

split(string(concat('{', first(split(last(split(outputs('DecodedContent'), '{')), '}')), '}')), ',')

output: 

So the first split does not work, there is no split action based on the comma ',' but the concat function containing two working split functions based on the '{' and '}' character.

I do not have a clue anymore what I can possibly do to solve this issue.

Any ideas are welcome

Thank you

[SudeepGhatakNZ]

@Vitss 

To split based on carriage return, try the %0A and for tab try %0D

split(varString, decodeUriComponent('%0A'))

[Vitss]

Thank You very much for the reply @SudeepGhatakNZ .

This worked for the '\r' and '\n' in the string.

Now there are the null values left '\u0000'

I did try decodeUriComponent('%0xC0') and decodeUriComponent('%0x80') in following expression:

replace(replace(replace(replace(outputs('Compose_CLRString'),decodeUriComponent('%0A'), ''), decodeUriComponent('%0D'), ''), decodeUriComponent('%0xC0'), ''), decodeUriComponent('%0x80'), '')

also had a try with 

decodeUriComponent(outputs('Compose_CLRString'))

but the '\U000' dont want to leave.

[Vitss]

Managed to clear the strigified json a bit more to have a proper start:

which is giving me a better startpoint and a better endpoint.

however the nullbytes are still present and I did not managed to replace them.

what I still find confusing is that in the formatting there seem to be newlines.

[SudeepGhatakNZ]

Nice,

Try setting a variable with an expression "null".

Use that in your replace function.

[Vitss]

replace(outputs('Compose_13'), variables('null'), '')

compose 13 has an output:

but getting error

Unable to process template language expressions in action 'Compose_15' inputs at line '0' and column '0': 'String cannot be of zero length. (Parameter 'oldValue')'

Thank you for your helpfull thinking

[SudeepGhatakNZ]

Can you share a sample text that I can test with?

[Vitss]

Sended you a PM @SudeepGhatakNZ 

Thank you again.

[Vitss]

Solved

[Vitss]

I will paste the solution Site is crashing with 2 browsers on this device.

[Vitss · Accepted solution]

Solution:

1. replace(outputs('DecodedContent'), ' ', '')                                
2. Compose propper start and end first(split(last(split(outputs('Compose_Space'), '{')), '}')) 

   3. split(outputs('Compose_PropperStartAndEnd'), ',') 

   

   4. 

   

replace(replace(replace(replace(first(split(item(), ':')), '"', ''), decodeUriComponent('%00'), ''), decodeUriComponent('%0A'), ''),decodeUriComponent('%0D'), '')

replace(replace(replace(replace(last(split(item(), ':')), '"', ''), decodeUriComponent('%00'), ''), decodeUriComponent('%0A'), ''),decodeUriComponent('%0D'), '')