perl5137delta(1) what is new for perl v5.13.7

DESCRIPTION

This document describes differences between the 5.13.6 release and the 5.13.7 release.

If you are upgrading from an earlier release such as 5.13.5, first read perl5136delta, which describes differences between 5.13.5 and 5.13.6.

Core Enhancements

Single term prototype

The "+" prototype is a special alternative to "$" that will act like "\[@%]" when given a literal array or hash variable, but will otherwise force scalar context on the argument. This is useful for functions which should accept either a literal array or an array reference as the argument: 

    sub smartpush (+@) {
        my $aref = shift;
        die "Not an array or arrayref" unless ref $aref eq 'ARRAY';
        push @$aref, @_;
    }

When using the "+" prototype, your function must check that the argument is of an acceptable type.

use re '/flags';

The "re" pragma now has the ability to turn on regular expression flags till the end of the lexical scope: 

    use re '/x';
    "foo" =~ / (.+) /;  # /x implied

See ``'/flags' mode'' in re for details.

Statement labels can appear in more places

Statement labels can now occur before any type of statement or declaration, such as "package".

use feature unicode_strings now applies to more regex matching

Another chunk of the ``The ''Unicode Bug"" in perlunicode is fixed in this release. Now, regular expressions compiled within the scope of the ``unicode_strings'' feature (or under the ``u'' regex modifier (specifiable currently only with infix notation "(?u:...)" or via "use re '/u'") will match the same whether or not the target string is encoded in utf8, with regard to "[[:posix:]]" character classes

Work is underway to add the case sensitive matching to the control of this feature, but was not complete in time for this dot release.

Array and hash container functions accept references

All built-in functions that operate directly on array or hash containers now also accept hard references to arrays or hashes: 

  |----------------------------+---------------------------|
  | Traditional syntax         | Terse syntax              |
  |----------------------------+---------------------------|
  | push @$arrayref, @stuff    | push $arrayref, @stuff    |
  | unshift @$arrayref, @stuff | unshift $arrayref, @stuff |
  | pop @$arrayref             | pop $arrayref             |
  | shift @$arrayref           | shift $arrayref           |
  | splice @$arrayref, 0, 2    | splice $arrayref, 0, 2    |
  | keys %$hashref             | keys $hashref             |
  | keys @$arrayref            | keys $arrayref            |
  | values %$hashref           | values $hashref           |
  | values @$arrayref          | values $arrayref          |
  | ($k,$v) = each %$hashref   | ($k,$v) = each $hashref   |
  | ($k,$v) = each @$arrayref  | ($k,$v) = each $arrayref  |
  |----------------------------+---------------------------|

This allows these built-in functions to act on long dereferencing chains or on the return value of subroutines without needing to wrap them in "@{}" or "%{}": 

  push @{$obj->tags}, $new_tag;  # old way
  push $obj->tags,    $new_tag;  # new way
  for ( keys %{$hoh->{genres}{artists}} ) {...} # old way 
  for ( keys $hoh->{genres}{artists}    ) {...} # new way

For "push", "unshift" and "splice", the reference will auto-vivify if it is not defined, just as if it were wrapped with "@{}".

Calling "keys" or "values" directly on a reference gives a substantial performance improvement over explicit dereferencing.

For "keys", "values", "each", when overloaded dereferencing is present, the overloaded dereference is used instead of dereferencing the underlying reftype. Warnings are issued about assumptions made in the following three ambiguous cases: 

  (a) If both %{} and @{} overloading exists, %{} is used
  (b) If %{} overloading exists on a blessed arrayref, %{} is used
  (c) If @{} overloading exists on a blessed hashref, @{} is used

y///r

The "/r" flag, which was added to "s///" in 5.13.2, has been extended to the "y///" operator.

It causes it to perform the substitution on a copy of its operand, returning that copy instead of a character count.

New global variable ${^GLOBAL_PHASE}

A new global variable, "${^GLOBAL_PHASE}", has been added to allow introspection of the current phase of the perl interpreter. It's explained in detail in ``${^GLOBAL_PHASE}'' in perlvar and ``BEGIN, UNITCHECK, CHECK, INIT and END'' in perlmod.

Unicode Version 6.0 is now supported (mostly)

Perl comes with the Unicode 6.0 data base updated with Corrigendum #8 <http://www.unicode.org/versions/corrigendum8.html>, with one exception noted below. See <http://unicode.org/versions/Unicode6.0.0> for details on the new release. Perl does not support any Unicode provisional properties, including the new ones for this release, but their database files are packaged with Perl.

Unicode 6.0 has chosen to use the name "BELL" for the character at U+1F514, which is a symbol that looks like a bell, and used in Japanese cell phones. This conflicts with the long-standing Perl usage of having "BELL" mean the ASCII "BEL" character, U+0007. In Perl 5.14, "\N{BELL}" will continue to mean U+0007, but its use will generate a deprecated warning message, unless such warnings are turned off. The new name for U+0007 in Perl will be "ALERT", which corresponds nicely with the existing shorthand sequence for it, "\a". "\N{BEL}" will mean U+0007, with no warning given. The character at U+1F514 will not have a name in 5.14, but can be referred to by "\N{U+1F514}". The plan is that in Perl 5.16, "\N{BELL}" will refer to U+1F514, and so all code that uses "\N{BELL}" should convert by then to using "\N{ALERT}", "\N{BEL}", or "\a" instead.

Improved support for custom OPs

Custom ops can now be registered with the new "custom_op_register" C function and the "XOP" structure. This will make it easier to add new properties of custom ops in the future. Two new properties have been added already, "xop_class" and "xop_peep".

"xop_class" is one of the OA_*OP constants, and allows B and other introspection mechanisms to work with custom ops that aren't BASEOPs. "xop_peep" is a pointer to a function that will be called for ops of this type from "Perl_rpeep".

See ``Custom Operators'' in perlguts and ``Custom Operators'' in perlapi for more detail.

The old "PL_custom_op_names"/"PL_custom_op_descs" interface is still supported but discouraged.

Incompatible Changes

Dereferencing typeglobs

If you assign a typeglob to a scalar variable: 

    $glob = *foo;

the glob that is copied to $glob is marked with a special flag indicating that the glob is just a copy. This allows subsequent assignments to $glob to overwrite the glob. The original glob, however, is immutable.

Many Perl operators did not distinguish between these two types of globs. This would result in strange behaviour in edge cases: "untie $scalar" would do nothing if the last thing assigned to the scalar was a glob (because it treated it as "untie *$scalar", which unties a handle). Assignment to a glob slot (e.g., "(*$glob) = \@some_array") would simply assign "\@some_array" to $glob.

To fix this, the "*{}" operator (including the *foo and *$foo forms) has been modified to make a new immutable glob if its operand is a glob copy. Various operators that make a distinction between globs and scalars have been modified to treat only immutable globs as globs.

This causes an incompatible change in code that assigns a glob to the return value of "*{}" when that operator was passed a glob copy. Take the following code, for instance: 

    $glob = *foo;
    *$glob = *bar;

The *$glob on the second line returns a new immutable glob. That new glob is made an alias to *bar. Then it is discarded. So the second assignment has no effect.

It also means that "tie $handle" will now tie $handle as a scalar, even if it has had a glob assigned to it.

The upside to this incompatible change is that bugs [perl #77496] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=77496>, [perl #77502] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=77502>, [perl #77508] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=77508>, [perl #77688] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=77688>, and [perl #77812] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=77812>, and maybe others, too, have been fixed.

See <http://rt.perl.org/rt3/Public/Bug/Display.html?id=77810> for even more detail.

Clearing stashes

Stash list assignment "%foo:: = ()" used to make the stash anonymous temporarily while it was being emptied. Consequently, any of its subroutines referenced elsewhere would become anonymous (showing up as ``(unknown)'' in "caller"). Now they retain their package names, such that "caller" will return the original sub name if there is still a reference to its typeglob, or ``foo::__ANON__'' otherwise [perl #79208] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=79208>.

Deprecations

\N{BELL} is deprecated

This is because Unicode is using that name for a different character. See ``Unicode Version 6.0 is now supported (mostly)'' for more explanation.

Performance Enhancements

  • When an object has many weak references to it, freeing that object can under some some circumstances take O(N^2) time to free (where N is the number of references). The number of circumstances has been reduced. [perl #75254] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=75254>.

Modules and Pragmata

New Modules and Pragmata

  • The following modules were added by the "Unicode::Collate" upgrade from 0.63 to 0.67. See below for details.

    "Unicode::Collate::CJK::Big5"

    "Unicode::Collate::CJK::GB2312"

    "Unicode::Collate::CJK::JISX0208"

    "Unicode::Collate::CJK::Korean"

    "Unicode::Collate::CJK::Pinyin"

    "Unicode::Collate::CJK::Stroke"

Updated Modules and Pragmata

  • "Archive::Extract" has been upgraded from 0.44 to 0.46

    Resolves an issue with NetBSD-current and its new unzip executable.

  • "Archive::Tar" has been upgraded from 1.68 to 1.72

    This adds the ptargrep utility for using regular expressions against the contents of files in a tar archive.

  • "B" has been upgraded from 1.24 to 1.26.

    It no longer crashes when taking apart a "y///" containing characters outside the octet range or compiled in a "use utf8" scope.

    The size of the shared object has been reduced by about 40%, with no reduction in functionality.

  • "B::Deparse" has been upgraded from 0.99 to 1.01.

    It fixes deparsing of "our" followed by a variable with funny characters (as permitted under the "utf8" pragma) [perl #33752] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=33752>.

  • "CGI" has been upgraded from 3.49 to 3.50

    This provides the following security fixes: the MIME boundary in multipart_init is now random and improvements to the handling of newlines embedded in header values.

    The documentation for param_fetch() has been corrected and clarified.

  • "CPAN" has been upgraded from 1.94_61 to 1.94_62
  • "CPANPLUS" has been upgraded from 0.9007 to 0.9010

    Fixes for the SQLite source engine and resolving of issues with the testsuite when run under local::lib and/or cpanminus

  • "CPANPLUS::Dist::Build" has been upgraded from 0.48 to 0.50
  • "Data::Dumper" has been upgraded from 2.129 to 2.130_01.
  • "DynaLoader" has been upgraded from 1.10 to 1.11.

    It fixes a buffer overflow when passed a very long file name.

  • "ExtUtils::Constant" has been upgraded from 0.22 to 0.23.

    The "AUTOLOAD" helper code generated by "ExtUtils::Constant::ProxySubs" can now "croak" for missing constants, or generate a complete "AUTOLOAD" subroutine in XS, allowing simplification of many modules that use it. ("Fcntl", "File::Glob", "GDBM_File", "I18N::Langinfo", "POSIX", "Socket")

    "ExtUtils::Constant::ProxySubs" can now optionally push the names of all constants onto the package's C{@EXPORT_OK}. This has been used to replace less space-efficient code in "B", helping considerably shrink the size of its shared object.

  • "Fcntl" has been upgraded from 1.09 to 1.10.
  • "File::Fetch" has been upgraded from 0.24 to 0.28

    "HTTP::Lite" is now supported for 'http' scheme.

    The "fetch" utility is supported on FreeBSD, NetBSD and Dragonfly BSD for the "http" and "ftp" schemes.

  • "File::Glob" has been upgraded from 1.09 to 1.10.
  • "File::stat" has been upgraded from 1.03 to 1.04.

    The "-x" and "-X" file test operators now work correctly under the root user.

  • "GDBM_File" has been upgraded from 1.11 to 1.12.

    This fixes a memory leak when DBM filters are used.

  • "Hash::Util" has been upgraded from 0.09 to 0.10.
  • "Hash::Util::FieldHash" has been upgraded from 1.05 to 1.06.
  • "I18N::Langinfo" has been upgraded from 0.06 to 0.07.
  • "Locale::Maketext" has been upgraded from 1.16 to 1.17.
  • "Math::BigInt" has been upgraded from 1.97 to 1.99_01.
  • "Math::BigRat" has been upgraded from 0.26 to 0.26_01
  • "Math::BigInt::FastCalc" has been upgraded from 0.22 to 0.24_01.
  • "MIME::Base64" has been upgraded from 3.09 to 3.10

    Includes new functions to calculate the length of encoded and decoded base64 strings.

  • "mro" has been upgraded from 1.04 to 1.05.
  • "NDBM_File" has been upgraded from 1.09 to 1.10.

    This fixes a memory leak when DBM filters are used.

  • "ODBM_File" has been upgraded from 1.08 to 1.09.

    This fixes a memory leak when DBM filters are used.

  • "Opcode" has been upgraded from 1.16 to 1.17.
  • "parent" has been upgraded from 0.223 to 0.224
  • "Pod::Simple" has been upgraded from 3.14 to 3.15

    Includes various fixes to "HTML" and "XHTML" handling.

  • "POSIX" has been upgraded from 1.21 to 1.22.
  • "re" has been upgraded from 0.13 to 0.14, for the sake of the new "use re "/flags"" pragma.
  • "Safe" has been upgraded from 2.28 to 2.29.

    It adds &version::vxs::VCMP to the default share.

  • "SDBM_File" has been upgraded from 1.07 to 1.08.
  • "SelfLoader" has been upgraded from 1.17 to 1.18.

    It now works in taint mode [perl #72062] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=72062>.

  • "Socket" has been upgraded from 1.90 to 1.91.
  • "Storable" has been upgraded from 2.22 to 2.24

    Includes performance improvement for overloaded classes.

  • "Sys::Hostname" has been upgraded from 1.13 to 1.14.
  • "Unicode::Collate" has been upgraded from 0.63 to 0.67

    This release newly adds locales "ja" "ko" and "zh" and its variants ( "zh__big5han", "zh__gb2312han", "zh__pinyin", "zh__stroke" ).

    Supported UCA_Version 22 for Unicode 6.0.0.

    The following modules have been added:

    "Unicode::Collate::CJK::Big5" for "zh__big5han" which makes tailoring of CJK Unified Ideographs in the order of CLDR's big5han ordering.

    "Unicode::Collate::CJK::GB2312" for "zh__gb2312han" which makes tailoring of CJK Unified Ideographs in the order of CLDR's gb2312han ordering.

    "Unicode::Collate::CJK::JISX0208" which makes tailoring of 6355 kanji (CJK Unified Ideographs) in the JIS X 0208 order.

    "Unicode::Collate::CJK::Korean" which makes tailoring of CJK Unified Ideographs in the order of CLDR's Korean ordering.

    "Unicode::Collate::CJK::Pinyin" for "zh__pinyin" which makes tailoring of CJK Unified Ideographs in the order of CLDR's pinyin ordering.

    "Unicode::Collate::CJK::Stroke" for "zh__stroke" which makes tailoring of CJK Unified Ideographs in the order of CLDR's stroke ordering.

Documentation

perlvar reorders the variables and groups them by topic. Each variable introduced after Perl 5.000 notes the first version in which it is available. perlvar also has a new section for deprecated variables to note when they were removed.

New Documentation

perlpodstyle

New style guide for POD documentation, split mostly from the NOTES section of the pod2man man page.

( This was added to "v5.13.6" but was not documented with that release ).

Changes to Existing Documentation

  • Array and hash slices in scalar context are now documented in perldata.
  • perlform and perllocale have been corrected to state that "use locale" affects formats.

Diagnostics

New Diagnostics

  • ``Using !~ with %s doesn't make sense'': This message was actually added in 5.13.2, but was omitted from perldelta. It now applies also to the "y///" operator, and has been documented.

Utility Changes

ptargrep
  • ptargrep is a utility to apply pattern matching to the contents of files in a tar archive. It comes with "Archive::Tar".

Testing

  • The new t/mro/isa_aliases.t has been added, which tests that "*Foo::ISA = *Bar::ISA" works properly.
  • t/mro/isarev.t has been added, which tests that "PL_isarev" (accessible at the Perl level via "mro::get_isarev") is updated properly.
  • t/run/switchd-78586.t has been added, which tests that [perl #78586] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=78586> has been fixed (related to line numbers in the debugger).

Platform Support

Platform-Specific Notes

Windows
Directory handles are now properly cloned when threads are created. In perl 5.13.6, child threads simply stopped inheriting directory handles. In previous versions, threads would share handles, resulting in crashes.

Support for building with Visual C++ 2010 is now underway, but is not yet complete. See README.win32 for more details.

VMS
Record-oriented files (record format variable or variable with fixed control) opened for write by the perlio layer will now be line buffered to prevent the introduction of spurious line breaks whenever the perlio buffer fills up.

Internal Changes

  • "lex_start" has been added to the API, but is considered experimental.
  • A new "parse_block" function has been added to the API [perl #78222] <http://rt.perl.org/rt3/Public/Bug/Display.html?id=78222>.
  • A new, experimental API has been added for accessing the internal structure that Perl uses for "%^H". See the functions beginning with "cophh_" in perlapi.
  • A stash can now have a list of effective names in addition to its usual name. The first effective name can be accessed via the "HvENAME" macro, which is now the recommended name to use in MRO linearisations ("HvNAME" being a fallback if there is no "HvENAME").

    These names are added and deleted via "hv_ename_add" and "hv_ename_delete". These two functions are not part of the API.

  • The way the parser handles labels has been cleaned up and refactored. As a result, the "newFOROP()" constructor function no longer takes a parameter stating what label is to go in the state op.
  • The "newWHILEOP()" and "newFOROP()" functions no longer accept a line number as a parameter.
  • A new "parse_barestmt()" function has been added, for parsing a statement without a label.
  • A new "parse_label()" function has been added, that parses a statement label, separate from statements.
  • The "CvSTASH()" macro can now only be used as an rvalue. "CvSTASH_set()" has been added to replace assignment to "CvSTASH()". This is to ensure that backreferences are handled properly. These macros are not part of the API.
  • The "op_scope()" and "op_lvalue()" functions have been added to the API, but are considered experimental.

Selected Bug Fixes

Obituary

Randy Kobes, creator of the kobesearch alternative to search.cpan.org and contributor/maintainer to several core Perl toolchain modules, passed away on September 18, 2010 after a battle with lung cancer. His contributions to the Perl community will be missed.

Acknowledgements

Perl 5.13.7 represents approximately one month of development since Perl 5.13.6 and contains 73100 lines of changes across 518 files from 39 authors and committers:

Abhijit Menon-Sen, Abigail, Ben Morrow, Chas. J. Owens IV, Chris 'BinGOs' Williams, Craig A. Berry, David Golden, David Mitchell, Father Chrysostomos, Fingle Nark, Florian Ragwitz, George Greer, Grant McLean, H.Merijn Brand, Ian Goodacre, Jan Dubois, Jerry D. Hedden, Jesse Vincent, Karl Williamson, Lubomir Rintel, Marty Pauley, Moritz Lenz, Nicholas Clark, Nicolas Kaiser, Niko Tyni, Peter John Acklam, Rafael Garcia-Suarez, Shlomi Fish, Steffen Mueller, Steve Hay, Tatsuhiko Miyagawa, Tim Bunce, Todd Rinaldo, Tom Christiansen, Tom Hukins, Tony Cook, Yves Orton, Zefram and brian d foy

Many of the changes included in this version originated in the CPAN modules included in Perl's core. We're grateful to the entire CPAN community for helping Perl to flourish.

Reporting Bugs

If you find what you think is a bug, you might check the articles recently posted to the comp.lang.perl.misc newsgroup and the perl bug database at http://rt.perl.org/perlbug/ . There may also be information at http://www.perl.org/ , the Perl Home Page.

If you believe you have an unreported bug, please run the perlbug program included with your release. Be sure to trim your bug down to a tiny but sufficient test case. Your bug report, along with the output of "perl -V", will be sent off to [email protected] to be analysed by the Perl porting team.

If the bug you are reporting has security implications, which make it inappropriate to send to a publicly archived mailing list, then please send it to [email protected]. This points to a closed subscription unarchived mailing list, which includes all the core committers, who be able to help assess the impact of issues, figure out a resolution, and help co-ordinate the release of patches to mitigate or fix the problem across all platforms on which Perl is supported. Please only use this address for security issues in the Perl core, not for modules independently distributed on CPAN.

LAST SEARCHED