Archie Miller spoke with brother Sean ‘very briefly’ after FBI investigation went public