cperl-5.24.2 released

add new 5.25 cdeltas,
update memory sizes and perlhist, STATUS.

Author: Reini Urban

MANIFEST

@@ -5070,6 +5070,9 @@ pod/perl5223cdelta.pod		cperl changes in version 5.22.3c
 pod/perl5224cdelta.pod		cperl changes in version 5.22.4c
 pod/perl5240cdelta.pod		cperl changes in version 5.24.0c
 pod/perl5241cdelta.pod		cperl changes in version 5.24.1c
+pod/perl5250cdelta.pod		cperl changes in version 5.25.0c
+pod/perl5251cdelta.pod		cperl changes in version 5.25.1c
+pod/perl5252cdelta.pod		cperl changes in version 5.25.2c
 pod/perl561delta.pod		Perl changes in version 5.6.1
 pod/perl56delta.pod		Perl changes in version 5.6
 pod/perl581delta.pod		Perl changes in version 5.8.1

STATUS.md

@@ -30,9 +30,8 @@ on two unrelated core tests (issignaling setpayloadsig + chmod linked in).
 Windows is smoked with MSVC 10 and 12 for 32 and 64bit.
 
 The current stable release is
-  [5.24.1c](https://github.com/perl11/cperl/releases/tag/cperl-5.24.2) - [perl5241cdelta](perl5241cdelta.html),
-the latest development release [5.25.1c](https://github.com/perl11/cperl/releases/tag/cperl-5.25.0) - [perl5251cdelta](perl5251cdelta.html).
-See the current changelog [cperl-5.25.2 delta](perlcdelta.html).
+  [5.24.2c](https://github.com/perl11/cperl/releases/tag/cperl-5.24.2) - [perl5242cdelta](perl5242cdelta.html),
+the latest development release [5.25.2c](https://github.com/perl11/cperl/releases/tag/cperl-5.25.2) - [perl5252cdelta](perl5252cdelta.html).
 We also have [5.22.4c](https://github.com/perl11/cperl/releases/tag/cperl-5.22.4), [perl5224cdelta](perl5224cdelta.html).
 
 All tests pass. CPAN works.
@@ -52,10 +51,8 @@ the patches are all provided in my
 upgrade is seemless.  E.g. Test2 (the new Test::Simple) broke >15
 modules without any patches.
 
-cperl-5.24.0c and cperl-5.24.1c have [about 24 fixes](perldelta.html#Known-Problems-fixed-elsewhere),
-for problems which are not fixed in perl-5.24.2.
-Ditto cperl-5.22.4c has about 20 fixes which are not in the latest
-perl-5.22.3.
+v5.24.0c, v5.24.1c and v5.24.2c have [about 24 fixes](perldelta.html#Known-Problems-fixed-elsewhere), for problems which are not fixed in perl-5.24.1.
+Ditto cperl-5.22.4c has about 20 fixes which are not in the latest perl-5.22.3.
 
 ![Memory usage: perl -e0](cperl-m0.png)
 
@@ -75,7 +72,7 @@ For all versions see [bench-all/](bench-all/index.html)
 * function return types declarations as attribute
 * many more builtin function attributes
 * shaped arrays with compile-time checks and optims
-* static loop optims
+* static loop optims, eliminated run-time bounds checks
 * fast arithmetic overflow
 * convert static method to subs
 * Config as XS
@@ -90,7 +87,7 @@ For all versions see [bench-all/](bench-all/index.html)
 * improved build system (make -s, faster, CC vs LD confusion)
 * hash keys keep the tainted info. see [perlsec](http://perldoc.perl.org/perlsec.html#Taint-mode)
   There are no known taint loopholes anymore.
-* fix ops using lexical `$_`. The lexical topic feature is supported.
+* fixes ops and modules using lexical `$_`. The lexical topic feature is supported.
 * readonly packages can be cloned with threads.
 * security and overlarge data fixes for Storable, YAML not yet.
 * include B-C, Cpanel::JSON::XS, YAML::XS, Devel::NYTProf, Term::ReadKey
@@ -99,7 +96,7 @@ For all versions see [bench-all/](bench-all/index.html)
   versions with a 'c' suffix, and 10x faster JSON and YAML usage. (esp. with cpan).
 * many typed and modernized core modules, where signatures and types make
   sense and cause not much trouble.
-* some security fixes for Unicode confusables, but more are needed (use strict 'names').
+* many security fixes for Unicode symbols. no mixed scripts, normalized, no \0.
 * handle method calls on protected stashes.
 * disallow silent overflows of hash and array indices or string/name lengths.
   New "Too many elements" error and many new "overlarge" or "too large" panics.
@@ -110,8 +107,11 @@ For all versions see [bench-all/](bench-all/index.html)
 * special handling for security warnings: protect against hash flood DoS. Warn on
   all known public attacks, as metasploit bind/reverse shells or the Storable attack
   with the new `warn_security` API.
-  Since 5.25.1 such security warnings are logged at STDERR/syslog with the
+  Since v5.25.1c such security warnings are logged at STDERR/syslog with the
   remote user/IP.
+* Support clang LTO "link time optimizations", using proper linkage attributes.
+  -fsanitize=cfi instead of -fstack-protector not yet.
+* Reproducible builds are default since v5.25.2c
 
 Most of them only would have a chance to be merged upstream if a p5p
 committer would have written it.
@@ -310,6 +310,17 @@ are limited. So they are based on master.
 
   compile/dump to native code via emacs unexec, on most platforms.
 
+* [feature/gh141-smallstring](https://github.com/perl11/cperl/issues/141)
+
+  [code](http://github.com/perl11/cperl/commits/feature/gh141-smallstring)
+
+  optimize space for small strings.
+
+and various [hash tables refactorings]((https://github.com/perl11/cperl/issues/24):
+
+feature/gh24-base-hash feature/gh24-he-array feature/gh24-oldnew-hash-table
+featurex/gh24-array_he featurex/gh24-hash-loop featurex/gh24-hash-loop+utf8
+featurex/gh24-hash-utf8
 
 ## A bit more work is needed for
 
@@ -347,6 +358,10 @@ They also revert some wrong decisions p5p already made.
   class, method and multi keywords but no dispatch, subtyping and type checks yet.
   in work.
 
+* various more hash tables:
+
+featurex/gh24-one-word-ahe featurex/gh24-open-hash
+
 ## Soon
 
 * user facing classes, multiple dispatch (fast for binary, slow for mega)
@@ -355,4 +370,4 @@ They also revert some wrong decisions p5p already made.
 
 * builtin ffi
 
-2016-10-28 rurban
+2016-12-16 rurban

cpan/Test-Simple/t/new_ok.t

@@ -37,5 +37,5 @@ use Test::More tests => 13;
 
 # And what if we give it nothing?
 eval q(new_ok(););
-like $@, qr/Not enough arguments for subroutine entry Test::More::new_ok\. Missing \$class at \(eval \d\) line 1, near "\(\)"\n/;
+like $@, qr/Not enough arguments for subroutine entry Test::More::new_ok\. Missing \$class at \(eval \d+\) line 1, near "\(\)"\n/;
 #is $@, sprintf "new_ok() must be given at least a class at %s line %d.\n", $0, __LINE__ - 2;

pod/perl.pod

@@ -228,6 +228,9 @@ aux c2ph h2ph h2xs cperlbug pl2pm pod2html pod2man splain xsubpp
 
     perlcperl		Perl notes for cperl (variant)
     perlcdelta		cperl changes since previous version
+    perl5252cdelta	cperl changes in version 5.25.2c
+    perl5251cdelta	cperl changes in version 5.25.1c
+    perl5250cdelta	cperl changes in version 5.25.0c
     perl5241cdelta	cperl changes in version 5.24.1c
     perl5240cdelta	cperl changes in version 5.24.0c
     perl5224cdelta	cperl changes in version 5.22.4c

pod/perl5250cdelta.pod

@@ -0,0 +1,203 @@
+=encoding utf8
+
+=head1 NAME
+
+perl5250cdelta - what is new for cperl v5.25.0
+
+=head1 DESCRIPTION
+
+This document describes perl-only differences between the cperl 5.24.0
+release and the cperl 5.25.0 release.
+
+If you are upgrading from an earlier release such as 5.22.3, first read
+L<perl5240cdelta>, which describes differences between 5.22.3 and 5.24.0.
+
+=head1 Notice
+
+perl5.24.1 was security update to a non-existing problem. cperl added
+PERLIO_DEBUG as optional handle to redirect DEBUGGING outout via -Dx
+switches to. This is only usable with DEBUGGING perls, which are not
+used in production, only during development.
+perl5.24.1 changed PERLIO_DEBUG to only be active for PerlIO debugging
+together with -Di.
+
+=head1 Performance Enhancements
+
+=over 4
+
+=item *
+
+for loops got several enhancements:
+
+new special B<iter_ary> C<for (@ary)> and B<iter_lazyiv> C<for (0..9)>
+ops to avoid a run-time switch in the generic iter op.
+
+more aelem_u optimizations, less run-time out of bounds checks for
+shaped arrays in loops. E.g. in C<my @a[5]; $a[$_] for (0..4);> the
+compilers knows that the max index for C<@a> will be C<4>, which is
+within the allowed shape of C<@a>.
+
+=item *
+
+The C<multideref> OP has a new C<MDEREF_INDEX_uoob> flag.  This is
+used for unchecked out-of-bounds checks for arrays, to use the
+previous AvSHAPED array optimizations (aelem_u, aelemfast_lex_u) or
+loop out-of-bounds elimination with multideref OPs also. Such
+multideref ops appear pretty often even with single indices.  E.g. in
+C<my @b=(0..4); for (0..$#b) { $b[$_] = 0; }> C<$b[$_]> is converted
+to a multideref, which previously was not optimized.
+
+Those optimized indices are marked with a new " _u" suffix in the dumped
+multideref stringification.
+
+C<MDEREF_MASK> changed to 0x10F, the C<MDEREF_SHIFT> size from 7 to 8.
+The shift can also use faster intrinsics now.
+
+The loop out-of-bounds elimination was fixed for simple lexical
+indices (e.g. C<for my $i (0..$#a){ $a[$i] }>, which leads now to
+more aelem_u ops and subsequent mderef_u optimizations also.
+
+=item *
+
+The new C<strQEc>/C<strNEc> macros are used instead of
+C<strEQ(s,"constant")>. This enables word-wise comparison via memcpy,
+in opposite of byte-wise comparisons via strcmp with already known
+sizes. This is a 10% performance improvement under most optimization
+levels.
+
+=back
+
+=head1 Modules and Pragmata
+
+=head2 Updated Modules and Pragmata
+
+=over 4
+
+=item *
+
+L<Opcode> has been upgraded from version 1.34c to 1.35c, with the new
+iter_ary and iter_lazyiv ops.
+
+=back
+
+=head1 Diagnostics
+
+The following additions or changes have been made to diagnostic output,
+including warnings and fatal error messages.  For the complete list of
+diagnostic messages, see L<perldiag>.
+
+=head2 New Diagnostics
+
+=head3 New Errors
+
+=over 4
+
+=item Invalid for range iterator (%d .. %d)
+
+(F) A range with constant integers as a for loop cannot be reversed.
+
+We check now at compile-time that a range with C<for> loops with
+constant integers is incremental, the 2nd number must be higher. We
+don't support reverse loops with ranges, i.e. C<for (9..0)> is
+invalid, but C<for (0..$#ary)> with C<$#ary> being C<-1> is valid.
+
+Reverse constant strings ranges are still valid and lead to an empty
+loop.  i.e. C<for ('z'..'a')> is currently valid.
+
+=back
+
+=head1 Platform Support
+
+=head2 Platform-Specific Notes
+
+=over 4
+
+=item mingw
+
+Compilation under mingw (32 and/or 64bit) was fixed by removing a
+duplicate F<pp_sys.c> entry in F<win32/GNUMakefile>.
+
+=item linux
+
+Check for null in pp_ghostent et al.
+
+On some platforms (such as Gentoo Linux with torsocks),
+hent->h_aliases (where hent is a struct hostent *) may be null after a
+gethostent call.
+
+L<RT#128740|https://rt.perl.org/Public/Bug/Display.html?id=128740>
+
+=back
+
+=head1 Internal Changes
+
+=over 4
+
+=item *
+
+The B<negate> op has now it's own B<ck_negate> callback.
+
+=back
+
+=head1 Selected Bug Fixes
+
+=over 4
+
+=item SvREADONLY_off: allow calls as argument
+
+No multiple evaluation of its argument anymore.
+
+=back
+
+=head1 Acknowledgements
+
+Perl 5.25.0 represents approximately 2 weeks of development since Perl 5.24.0c
+and contains approximately 6,300 lines of changes across 120 files from 4
+authors.
+
+Excluding auto-generated files, documentation and release tools, there were
+approximately 3,900 lines of changes to 53 .pm, .t, .c and .h files.
+
+Perl continues to flourish into its third decade thanks to a vibrant community
+of users and developers. The following people are known to have contributed the
+improvements that became Perl 5.25.0:
+
+Reini Urban, Father Chrysostomos, Daniel Dragan, Tony Cook.
+
+The list above is almost certainly incomplete as it is automatically generated
+from version control history. In particular, it does not include the names of
+the (very much appreciated) contributors who reported issues to the Perl bug
+tracker.
+
+For a more complete list of all of Perl's historical contributors, please see
+the F<AUTHORS> file in the Perl source distribution.
+
+=head1 Reporting Bugs
+
+If you find what you think is a bug, you might check the articles recently
+posted to the comp.lang.perl.misc newsgroup and the perl bug database at
+https://rt.perl.org/ .  There may also be information at
+http://www.perl.org/ , the Perl Home Page.
+
+If you believe you have an unreported bug, please run the L<cperlbug> program
+included with your release.  Be sure to trim your bug down to a tiny but
+sufficient test case.  Your bug report, along with the output of C<perl -V>,
+will be sent off to perlbug@perl.org to be analysed by the Perl porting team.
+
+If the bug you are reporting has security implications which make it
+inappropriate to send to a publicly archived mailing list, then see
+L<perlsec/SECURITY VULNERABILITY CONTACT INFORMATION>
+for details of how to report the issue.
+
+=head1 SEE ALSO
+
+The F<Changes> file for an explanation of how to view exhaustive details on
+what changed.
+
+The F<INSTALL> file for how to build Perl.
+
+The F<README> file for general stuff.
+
+The F<Artistic> and F<Copying> files for copyright information.
+
+=cut