I wouldn't ditch the knife. Ever.
Assuming you are carrying a folder with some kind of clip, try putting it in the waistband of your trousers in front of your pelvis. If you are right-handed and your belt buckle is at 12 o'clock, the knife goes about 1 o'clock. It is probably most comfortable at an angle somewhat above horizontal.
Assuming you are carrying a folder with some kind of clip, try putting it in the waistband of your trousers in front of your pelvis. If you are right-handed and your belt buckle is at 12 o'clock, the knife goes about 1 o'clock. It is probably most comfortable at an angle somewhat above horizontal.