The fall/winter breeding salamanders are already going or gone: Marbled Salamander, Small-mouthed Salamander, Four-toed Salamander, etc. So, appropriate breeding sites should have larvae at least. Spotted Salamanders, which are very common, should be breeding soon. Still a little early for most frog breeding, but any rains upcoming could spark activity: Spring Peepers, Chorus Frogs, Leopard Frogs, etc. Most of these mentioned will breed in ditches and puddles and temporally flooded areas. You probably won't have as much success this time of year in larger lake water or moving streams. If you do search the lake, probably shallower backwater. If you can listen on rainy nights, the frogs calling will lead you to the ideal breeding grounds.
As the season warms up, you'll likely have more options with frogs, but fewer with salamanders. Spring and summer breeding frogs may definitely breed within aquatic vegetation along the edges of lakes, particularly during rainy nights.
The Little Rock area could potentially have venomous snakes, particularly Cottonmouth, so please show appropriate caution with your youngsters.
Good luck and report back what you find!