How to include an entire column starting at a particular row in a formula in Excel?

You can use either OFFSET, either INDIRECT to refer the custom range:

• OFFSET(A5,0,0,ROWS(A:A)-ROW(A5)+1)
• INDIRECT("A5:A"&ROWS(A:A))

Both result in a range from A5 to the bottom of the column.