With a length of 2.1" I would have held it in a collet chuck for concentricity, drill one side a bit more than half through, flip & drill the other to connect. Common issues for drifting drill
- drill not centered (TS off or collet block off in mill mode)
- drill edge geometry unequal causing pull/drift (use a fresh drill or anyways equally sharpened lands)
- too long a drill (use a stubby which is more rigid) & (drill half way on either side as mentioned)
- use a spotting drill with included angle >= drill angle (example 120-deg spot for 118-deg drill). Not a 60-deg countersink type drill like our shop teacher taught us
- oil & pecking & chip removal is always a good strategy
- if push comes to shove & you use EM, or carbide EM for even more stiffness, you still have to be aware of tip geometry. Sometimes its still better to drill undersize pilot hole even if it is off, but the EM cutting is not getting bogged down in the center. They are intended for plunging but not really drilling or deep drilling. They don't have any taper & you may run out of cutting edge vs depth. Carbide is hard & may tend to slip in chuck jaws but that's a side issue.
Anyway you got-r-done