I have a few data sources defined from the carbon management console, where can I find those stored?
I have already looked through the files but can't find anything.
Those are not stored in any file. They are stored in the registry. See this location in registry.
/_system/config/repository/components/org.wso2.carbon.ndatasource/
Edit: You can browse registry like this.