When creating an Advanced Custom Import Format, groups are used to indicate that your file will have repeating groups of fields. Since the Advanced Custom Format defines an entire file structure, not just the individual record structure, repeating groups would be things like the transaction details for payments imports, or beneficiary information for beneficiary library imports.