How to change the kernel name in Jupyter Notebook running on Windows?

If nb_conda_kernels package is not used (as in this case), the name of the kernel is taken from the kernel spec file. To find the the kernel spec use jupyter kernelspec list command:

(base) C:\Users\user>jupyter kernelspec list
Available kernels:
  python2    C:\Anaconda2\share\jupyter\kernels\python2

For each kernel there will be kernel.json file in the corresponding folder, where display_name can be changed:

{
 "display_name": "Python 2", 
 "language": "python", 
 "argv": [
  "C:\\Anaconda2\\python.exe", 
  "-m", 
  "ipykernel_launcher", 
  "-f", 
  "{connection_file}"
 ]
}

In my case it's a Python 2 environment, but the format is the same for Python 3.