In python how to cross match sources with a given mask?
I have a dataframe that is a catalogue of astronomical sources (galaxies) spread across most of the sky. I also have a .fits binary mask that covers only some parts of the sky (see below). I want to cross-match the catalogue with the mask to get only the galaxies that fall within the mask. How can I do this, e.g. with healpy?
Solution
One way to do this is the following:
df_cat = pd.read_csv('file_path_cat.txt', names=['ra', 'dec', 'z', 'flag', 'var1', 'var2'])
nside = 64 #the value here depends on the mask you are using, it's mostly contained
# in the name of the mask and is usually 64, 128 or 512
N = 12*nside**2
# convert to HEALPix indices and subsample the PS data
indices = hp.ang2pix(nside, df_cat.ra.values, df_cat.dec.values, lonlat=True)
mask = hp.read_map('mask_file_path.fits')
df_cat['sky_mask'] = np.array(mask[indices]).byteswap().newbyteorder()
# eventually, keep only the sources in df_cat with 'sky_mask'==1, since they are within the mask
df_cross_matched = df_cat[df_cat.sky_mask==1]
Notebooks I have used this approach in are data_exploration_20220825.ipynb and Joining_and_processing_pyhod_bins_to_one_population.ipynb
- ImproperlyConfigured: You're using the staticfiles app without having set the STATIC_ROOT setting to a filesystem path
- With Pydantic V2 and model_validate, how can I create a "computed field" from an attribute of an ORM model that IS NOT part of the Pydantic model
- Simple log filtering with Flask
- How can I access different Anaconda environment from Pycharm (on Windows 10)
- Create regex-like (run length encoding) of string s for blocks of a given length k
- Failed scipy install using pip on Windows [Preparing metadata (pyproject.toml) did not run successfully]
- How to form tuple column from two columns in Pandas
- Filtering dictionary elements by few initial values
- Filter DataFrame events not in time windows DataFrame
- PyTorch .to(torch.device("cuda")) slow when first called?
- Finding many strings in directory
- How to set the default of a JSONField to empty list in Django and django-jsonfield?
- How to solve "OSError: telling position disabled by next() call"
- How can I stream a response from LangChain's OpenAI using Flask API?
- cannot import name 'randn_tensor' from 'diffusers.utils'
- Pylance doesn't catch all deprecated functions or classes
- Python: Cannot get attribute from superclass
- Python tkinter - grid configuration
- How do I override __getattr__ without breaking the default behavior?
- Algorithm for transformation of an 1-D-gradient into a special form of a 2-D-gradient
- Communication link failure with pyodbc
- Python - how to overwrite output from Markdown library
- Convert string based NaN's to numpy NaN's
- Selenium-Python returning empty text for one specific class or tag in HTML but not visible on webpage
- Referencing columns by assigned name in numpy array
- Pretty-print indices/coordinates of 2D Numpy array
- Can I force array numpy to keep its uint32 type?
- Reshape dataframe into a timeseries when time information is split into columns and index?
- Simple math addition
- Docker: ModuleNotFoundError: No module named 'tabulate'