[Pcre-svn] [911] code/trunk: Increment dummy ovector size in…

Top Page
Delete this message
Author: Subversion repository
Date:  
To: pcre-svn
Subject: [Pcre-svn] [911] code/trunk: Increment dummy ovector size in internal structures to avoid spurious array
Revision: 911
          http://www.exim.org/viewvc/pcre2?view=rev&revision=911
Author:   ph10
Date:     2018-01-16 16:50:40 +0000 (Tue, 16 Jan 2018)
Log Message:
-----------
Increment dummy ovector size in internal structures to avoid spurious array 
bound checker warnings. This fixes oss-fuzz 5415.


Modified Paths:
--------------
    code/trunk/ChangeLog
    code/trunk/src/pcre2_intmodedep.h


Modified: code/trunk/ChangeLog
===================================================================
--- code/trunk/ChangeLog    2018-01-13 16:53:02 UTC (rev 910)
+++ code/trunk/ChangeLog    2018-01-16 16:50:40 UTC (rev 911)
@@ -125,7 +125,16 @@
 This could not actually cause a crash because it was always used in a memcpy()
 call with zero length.


+30. Some internal structures have a variable-length ovector[] as their last
+element. Their actual memory is obtained dynamically, giving an ovector of
+appropriate length. However, they are defined in the structure as
+ovector[NUMBER], where NUMBER is large so that array bound checkers don't
+grumble. The value of NUMBER was 10000, but a fuzzer exceeded 5000 capturing
+groups, making the ovector larger than this. The number has been increased to
+131072, which allows for the maximum number of captures (65535) plus the
+overall match. This fixes oss-fuzz issue 5415.

+
Version 10.30 14-August-2017
----------------------------


Modified: code/trunk/src/pcre2_intmodedep.h
===================================================================
--- code/trunk/src/pcre2_intmodedep.h    2018-01-13 16:53:02 UTC (rev 910)
+++ code/trunk/src/pcre2_intmodedep.h    2018-01-16 16:50:40 UTC (rev 911)
@@ -7,7 +7,7 @@


                        Written by Philip Hazel
      Original API code Copyright (c) 1997-2012 University of Cambridge
-          New API code Copyright (c) 2016-2017 University of Cambridge
+          New API code Copyright (c) 2016-2018 University of Cambridge


 -----------------------------------------------------------------------------
 Redistribution and use in source and binary forms, with or without
@@ -640,11 +640,13 @@
   uint16_t name_count;            /* Number of name entries in the table */
 } pcre2_real_code;


-/* The real match data structure. Define ovector large so that array bound
-checkers don't grumble. Memory for this structure is obtained by calling
-pcre2_match_data_create(), which sets the size as the offset of ovector plus
-pairs of elements for each capturing group. (See also the heapframe structure
-below.) */
+/* The real match data structure. Define ovector as large as it can ever
+actually be so that array bound checkers don't grumble. Memory for this
+structure is obtained by calling pcre2_match_data_create(), which sets the size
+as the offset of ovector plus a pair of elements for each capturable string, so
+the size varies from call to call. As the maximum number of capturing
+subpatterns is 65535 we must allow for 65536 strings to include the overall
+match. (See also the heapframe structure below.) */

 typedef struct pcre2_real_match_data {
   pcre2_memctl     memctl;
@@ -657,7 +659,7 @@
   uint16_t         matchedby;     /* Type of match (normal, JIT, DFA) */
   uint16_t         oveccount;     /* Number of pairs */
   int              rc;            /* The return code from the match */
-  PCRE2_SIZE       ovector[10000];/* The first field */
+  PCRE2_SIZE       ovector[131072]; /* Must be last in the structure */
 } pcre2_real_match_data;



@@ -804,7 +806,7 @@
runtime array bound checks don't catch references to it. However, for any
specific call to pcre2_match() the memory allocated for each frame structure
allows for exactly the right size ovector for the number of capturing
- parentheses. */
+ parentheses. (See also the comment for pcre2_real_match_data above.) */

   PCRE2_SPTR eptr;           /* MUST BE FIRST */
   PCRE2_SPTR start_match;    /* Can be adjusted by \K */
@@ -813,7 +815,7 @@
   uint32_t capture_last;     /* Most recent capture */
   PCRE2_SIZE last_group_offset;  /* Saved offset to most recent group frame */
   PCRE2_SIZE offset_top;     /* Offset after highest capture */
-  PCRE2_SIZE ovector[10000]; /* Must be last in the structure */
+  PCRE2_SIZE ovector[131072]; /* Must be last in the structure */
 } heapframe;


typedef char check_heapframe_size[