Rabbi Lazarus Morris Goldman took on the headmaster position of the St Kilda Hebrew School in 1929 and remained there for the next 3 years. This role added to a list of duties including synagogue official, army chaplain, Rabbi, teacher and author.

In September 1932 Goldman took on the position of assistant minister and secretary of the Melbourne Hebrew Congregation. 1940 saw his next role take shape when he was recommended as the Jewish Chaplain to the AIF (6th Division). As Chaplain, Lazarus Goldman sailed on HMT Strathaird from Port Melbourne to the Middle East.  Later that year, while in Jerusalem, Goldman received his Semicha and continued his service as chaplain in the Middle East from 1940 – 1943 where he was greatly admired. Upon his return to Australia, Chaplain Colonel Jacob Danglow asked him to return to active service, this time in the Pacific War region.  Once back in Australia again, after a total of 6 years of active service, Rabbi Goldman returned to the Melbourne Hebrew Congregation, while also becoming Principal of the United Jewish Education Board.

Rabbi Lazarus Goldman had married Sarah Cohen in 1932 and had two children, David and Nina (Krauss). He died in 1960 after having served the Melbourne Jewry through education and prayer, and through his book outlining the Jewish history in Victoria from 1840 -1960.