Handling data containing comma in a CSV file
I have a CSV File that I am trying to read from Amazon S3 in Mosaic Decisions. This file contains an Address column in which the data itself contains a comma.
Example data in the file is shown below:
Address
sl,name,address
1,Ratan Kumar,FlatNo 122,Mumbai,Maharashtra
In this case, the address field is getting separated into 3 columns as- address, Missing_header_0, Missing_header_1 and the data is read as
sl,name,address,Missing_header_0, Missing_header_1
1,Ratan Kumar,FlatNo 122,Mumbai,Maharashtra
This corrupts the actual data and overrides the next column data How can we avoid this scenario?
Solution
To avoid this scenario,
- Open the Reader node configuration
- Pass a single quote (') or double quote (") in the Quote text box available in the configuration tab
This feature of Mosaic Decisions allows wrapping the data in each field with quotes.
This would give the desired outcome.
- csv.Error: iterator should return strings, not bytes
- How to correctly read a CSV file while escaping delimiter comma placed within square brackets using Apache Spark and Scala?
- Parse a tab-delimited, multiline text into an array of associative arrays using predefined column names
- sqlite3 import csv with column and row separator
- Convert every two values in a comma-separated string into associative array elements
- How can I separate tokens when there are some null tokens
- Writing dictionary items in csv correct format
- Handling empty cells and using null in Examples from a CSV file
- How to concatenate text from multiple rows into a single text string in SQL Server
- Retrieve whole lyrics from URL
- Export table to file with column headers (column names) using the bcp utility and SQL Server 2008
- read csv file delimited by file separator control character (FS/ASCII 28/UTF-8 0x1C) into duckdb using the CLI
- Efficiently filtering comma separated strings in pandas/dask
- How to parse a CSV file using PHP
- Sanitize a CSV string containing double quoted values
- error "no such file or directory" when reading in csv file in python
- how to make a function that check if the csv file is valid or not? (python)
- Techniques on how to export large CSV file with Symfony
- delete alternate lines in a csv file libreoffice calc
- Why is my record map overwriting other fields in csvhelper?
- Struct to CSV data as string without creating CSV file
- Some characters in CSV file are not read during PHP fgetcsv()
- How to split a comma-separated value to columns
- Is there a way to deserialize CSV to object, mapping by varied column names?
- SSISDB package errs out, says variable does not exist
- Django: How do I create a model dynamically?
- importing CSV file to mysql, there is in persian(utf-8) formate text
- Convert JSON to CSV using PowerShell
- Alternative for ImageDataGenerator for custom dataset
- Where value in column containing comma delimited values