A nuclear submarine is a submarine which is powered by a nuclear reactor, but not necessarily nuclear-armed.
A nuclear submarine is far more superior to conventional submarines but the high cost of nuclear technology means that only few countries can afford them. Here is a list of those countries
While Australia doesn’t have a nuclear submarine yet, it has signed an agreement called AUKUS with the US and UK to have a nuclear powered submarine by 2040.