How to substitute for null values if it is a categorical variable?
I was trying to get dummy values for my data, when I noticed some values are having '?' as their value. As many rows in my data have these values, I simply cannot drop them. In such case what should I replace them with? Just taking the mode of the category will help? Also, I tried to replace the ? values with the mode.
df1 = df1[df1.workclass == '?'].replace('?',"Private")
But I get an empty table now.
It depends on the dataset. There are different methods that apply to different features. Some may require just replacing with the mode. In some cases, different ML algorithms and models are also used such as Random Forest, KNN, etc. So it completely depends on the type of data you are handling. Explore the field of data exploration. Maybe this can help you.
- csv.reader() is separating values by individual character
- Python "forgets" variables? (between requests in web server context)
- "MultipleObjectsReturned or ObjectDoesNotExist error when accessing 'google' provider in Django-allauth"
- Mod operator in Free Pascal gives a different result than expected
- how to send a picture from server to client in python
- Condensing a Python method that does a different comparison depending on the operator passed
- How to merge and sum of two dictionaries in Python?
- How to create image of confusion matrix in Python
- How to add a date column with a condition?
- Access iPhone photo library using Kivy
- VS Code not picking up args list from launch.json
- Chrome 122 - How to allow insecure content? (Insecure download blocked)
- What is causing some points to fail sampling an enclosing mesh? / How do I prevent points from failing to sample an enclosing mesh?
- Modify JSON data in Python 3
- How to get the file modification date in UTC from Python
- What are the python builtin __exit__ argument types?
- How to plot a Probability Density Function in Python?
- Counter-intuitive results when mixing dataclass and enum
- Integer factorization in python
- IOError: Can't read data (Can't open directory) - Missing gzip compression filter
- Random word generator- Python
- Pass parameters to custom transformer in sklearn
- How to convert string to bytes in Python 3
- MongoEngine library doesn't allow to use its BaseFields for persisting data
- Identify broken XML files inside a zipped archive
- How to configure FastAPI logging so that it works both with Uvicorn locally and in production?
- Keep first instance of duplicate column name, unless empty then keep second instance of column
- rounding up time to last 30 mins interval
- How to install Python script on Windows?
- Apply a function to 2 columns in Polars