In an email shared by Android Authority, Google states that they've "made it easier for Gemini to interact with your [Android] device" and that Gemini will "help you use" various apps "whether your Gemini Apps Activity is on or off." If you don't want this, you'll have to disable the feature in the Apps settings page, but Google hasn't yet provided an explanation of how this will work.
