If you are using and escrow company, money is held by the escrow company and disbursed as per escrow instructions. Since you are getting an FHA loan, I'm guessing that's the procedure. The lender won't release funds until all THEIR conditions are met.
Rule #684.3 - don't pay anyone outside escrow unless required to by the lender. i.e. appraisal, termite reports, etc. Especially NOT the dealer/seller.
Some of them have come up missing!