Is there any way with which I can check what all the places a specific public group is used for and then delete the public groups in Salesforce?

Yes sure, you can check what all the places a specific public group is used for and then delete the public groups in Salesforce.

You can use SOQL like below to get a list of Accounts with which the record has been shared and the Cause(Rule, Manual etc).
SELECT ID, AccountId , IsDeleted, RowCause FROM AccountShare WHERE UserOrGroupId='???????'
You can repeat this for all custom and standard objects and you can get the list of objects itself from the following query.
list allObjects = Schema.getGlobalDescribe().Values();

This will tell you the records of different objects which are shared with the group. As long as you would like to know only records which are shared, this approach is good enough.