does OpenJdk provide complete opensource implementation for java along with JVM and compiler sources, so that it can be modified by others and implement to distribute
Yes, OpenJDK is the Reference Implementation of Java SE.
It includes JVM, Class Library, tools etc.
The modification and distribution is subject to GNU General Public License, version 2 with the Classpath Exception.