Magnetic phases and zone-folded phonons in a frustrated van der Waals magnet