Research the best rod and reel for you and off you go. Fishing tackle shops will be able to offer advice on equipment and you will pick up more tips along the way. Your equipment does not have to be expensive, particularly for hobby fishing. Research reviews on the various size fishing rods, the type of fish you will likely be after locally, and just ensure that you have a decent quality reel. Prefilled tackle boxes are a great way to start. A basic tackle box generally includes various sized hooks, sinkers, long-nosed pliers or other implement to handle fish safely, and a standard fishing line. There is an array of these available depending on the environment that you will be fishing in. Again, ask for advice.
Local fishing charters are a great way to get started before you invest time and money, as they generally provide all equipment and assist with baiting hooks etc., and lots of general advice. The charters are a great outing either alone, or with family and friends and make for a very social atmosphere and a great learning environment.
Join a local fishing/angling club and get involved in everything that they offer. Apart from the social aspect, the fisherfolk will likely offer to take you out on their boats and there will also be club competitions, general fishing including ladies days and boating events in which you can participate.
Before you start, you will need a mandatory fishing licence which are readily and cheaply available online. Search for your state’s website and purchase online with options for different length of time options – licences are generally then emailed directly to you.