An acoustic finite element approach for studying boundary flexibility and sound transmission between irregular enclosures