Yes, then you lose a point.
According to ITTF's Rules (The International Table Tennis Federation's Handbook 2019 v2):
2.5.1 A rally is the period during which the ball is in play.
2.5.2 The ball is in play from the last moment at which it is stationary on the palm of
the free hand before being intentionally projected in service ...