I understand your concern but please be mindful of the situation that your manager might be in. First of all, unplanned leaves are not the same as planned leaves. You may have a lot of leaves left with you but try to plan them in advance. Some companies put a restriction on leaves during the notice period or some type of leaves are not allowed, so check the policy or confirm with HR.
Communicate well with your manager and try to leave things on a good note. Also, some managers are sceptical about the leaves/behaviour of people on notice period as it gives a certain impression on the other team members and they might do the same when they serve the notice period. Talk to your manager and inform that you understand the situation and would be professionally fulfilling the duties. Ask for their support as well during this period as it is a two way street. Good luck!