Is it possible to create a custom field only for certain users?

Not currently. If a user has visibility over a person, deal, or company, they also have the ability to edit any of the record's system and custom fields.