I was able to overcome this by using the "vh" metric with max-height on the .modal-body element. 70vh looked about right for my uses. Then set the overflow-y to auto so it only scrolls when needed.
.modal-body {
overflow-y: auto;
max-height: 70vh;
}