Yihui documented figure referencing very well. There is only one thing I need to add: do remember to add a figure caption if you want to reference it.
For example, if we have a chunk label without a figure caption:
plot(pressure)
<img src=“https://hongtaoh.com/en/blog/2020-08-21-do-include-a-fig-cap-when-referencing-a-figure-in-bookdown-or-blogdown_files/figure-html/first-label-1.png" width=“672” …