Thu Aug 20 12:18:22 IDT 2020
============================

There were too many files tracking different thoughts and ideas for
things to do, or consider doing.  This file merges them into one. As
tasks are completed, they should be removed.

This file should exist only in the master branch or branches based off
of it for development, but not in the stable branch. This may require some
careful work with Git.

TODO
====

Minor Cleanups and Code Improvements
------------------------------------

	API:
		??? #if !defined(GAWK) && !defined(GAWK_OMIT_CONVENIENCE_MACROS)

	?? Add debugger commands to reference card

	Look at function order within files.

	Consider removing use of and/or need for the protos.h file.

	Fully synchronize whitespace tests (for \s, \S in Unicode
	environment) with those of GNU grep.

	Lint option which would allow extensions and only complain
	about genuine errors.

	Go through the FIXMEs in the manual and fix as many as possible.

Minor New Features
------------------

	Enable command line source text in the debugger.

	Enhance extension/fork.c waitpid to allow the caller to specify
	the options.  And add an optional array argument to wait and
	waitpid in which to return exit status information.

	Consider relaxing the strictness of --posix.

	Enhance --lint=invalid to apply in more places.

	? Add an optional base to strtonum, allowing 2-36.

	? Optional third argument for index indicating where to start the
	search.

	Suggested by Jannick:
	* It is possible to make gawk look for a file with extension name
	plus API version number(s) in case a shared lib with the expected
	basename cannot be found?  This would help have extension versions
	compiled against different API versions in one single directory
	and make gawk pick the extension with the right API version.

Major New Features
------------------

	Think about how to generalize indirect access. Manuel Collado
	suggests things like

		foo = 5
		@"foo" += 4

	Also needed:

		Indirect through array elements, not just scalar variables

	Add ability to do decimal arithmetic.

	Rework management of array index storage. (Partially DONE.)

	Consider using an atom table for all string array indices.

	DBM storage of awk arrays. Try to allow multiple dbm packages.

	?? A RECLEN variable for fixed-length record input. PROCINFO["RS"]
	would be "RS" or "RECLEN" depending upon what's in use.
	*** Could this be done as an extension?

	?? Use a new or improved dfa and/or regex library.

	Rewrite in C++.

Things To Think About That May Never Happen
-------------------------------------------

	Consider making shadowed variables a warning and not
	a fatal warning when --lint=fatal.

	Similar for extra parameters in a function call.

	Look at code coverage tools, like S2E: https://s2e.epfl.ch/
	
	Try running with diehard. See http://www.diehard-software.org,
	https://github.com/emeryberger/DieHard

	Include a sample rpm spec file in a new packaging subdirectory.
	(Really needed?)

	Patch lexer for @include and @load to make quotes optional.
	(Really needed?)

	Add a lint check if the return value of a function is used but
	the function did not supply a value.

	Consider making gawk output +nan for NaN values so that it
	will accept its own output as input.
		NOTE: Investigated this.  GLIBC formats NaN as '-nan'
		and -NaN as 'nan'.  Dealing with this is not simple.

	Review the bash source script for working with shared libraries in
	order to nuke the use of libtool. [ Partially started in the
	dead-branches/nolibtool branch. ]

Things That We Decided We Will Never Do
=======================================

	See if something like  b = a "" can be optimized to not do
	a concatenation, but instead just set STRCUR on a.
	(Tried this; the type of b doesn't come out correctly.)

	Consider moving var_value info into Node_var itself to reduce
	memory usage. This would break all uses of get_lhs in the
	code. It's too sweeping a change.

	Add macros for working with flags instead of using & and |
	directly.

	FIX regular field splitting to use FPAT algorithm.
		Note: Looked at this. Not sure it's with the trouble:
		If it ain't broke...

	Scope IDs for IPv6 addresses

	Gnulib

	Make FIELDWIDTHS be an array?

	"Do an optimization pass over parse tree?"
	This isn't relevant now that we are using a byte code engine.

	"Consider integrating Fred Fish's DBUG library into gawk."
	I did this once as an experiment. But I don't see a lot of value
	to this at this stage of the development. Stepping through things
	in a debugger is generally enough. Also, I would have to try to
	track down the latest version of this.

	"Make 	awk '/foo/' files...	run at egrep speeds" (How?)
	This has been on the list since the early days (gawk 1.x or early
	2.x).  But I am not sure how to really do this, nor have I done
	timings, nor does there seem to be any real demand for this.

	Change from dlopen to using the libltdl library (i.e. lt_dlopen).
	This may support more platforms.  If we move off of libtool
	then this is the wrong direction.