Do I need to stay in Indonesia during the extension process of my Remote Work KITAS?

Yes, you must remain in the country throughout the entire extension process, partly due to the required in-person biometric registration at the immigration office.